Kinesis

Question 1

Which AWS serverless streaming data service simplifies capturing, processing, and storing data streams at any scale?

Answer 1

Kinesis Data Streams - public, regional, and highly available AWS service

Question 2

What is the minimum and maximum retention period for data in Kinesis Data Streams?

Answer 2

By default, Kinesis Data Streams retains data for 24 hours, but this can be extended to up to 365 days for an additional cost

Question 3

When using Kinesis Data Streams, is it possible to configure more than one producer and consumer?

Answer 3

Yes, Kinesis Data Streams supports multiple producers for data ingestion and multiple consumers for data reading

Question 4

Which Kinesis Data Streams component is responsible for scaling?

Answer 4

Shards

Question 5

Which Kinesis Data Streams components can impact pricing?

Answer 5

The number of shards and the configured data retention window (24 hours to 365 days)

Question 6

Where is data stored in Kinesis Data Streams?

Answer 6

Data is stored in Kinesis Data Records, with each record up to 1 MB in size

Question 7

Which AWS service is ideal for large-scale data ingestion by numerous producers, with multiple consumers processing data at varying rates, for analytics and monitoring application clicks?

Answer 7

Amazon Kinesis Data Streams

Question 7

Which AWS service is used to transfer data from Kinesis Data Streams to other AWS services?

Answer 7

Amazon Kinesis Data Firehose

Question 8

How can Kinesis Video Streams performance be improved?

Answer 8

By increasing the number of shards, each shard supports up to 1 MB/s for ingestion and 2 MB/s for consumption

Question 9

Which AWS serverless service is used to capture, transform, and load large volumes of streaming data from hundreds of thousands of sources into AWS services like S3, Redshift, or OpenSearch?

Answer 9

Kinesis Data Firehose

Question 10

What is the primary purpose of Kinesis Data Firehose?

Answer 10

To load data into data lakes, storage solutions, and analytics services

Question 11

Is Kinesis Data Firehose a real-time service?

Answer 11

No, it operates in near-real-time, typically delivering data within ~60 seconds

Question 12

Can Kinesis Data Firehose perform on-the-fly data transformations?

Answer 12

Yes, it can use AWS Lambda for transformations, though this may introduce some latency

Question 13

How is billing calculated for Kinesis Data Firehose?

Answer 13

It is based on the volume of data processed through the service

Question 14

What are common destinations for Kinesis Data Firehose?

Answer 14

• S3
• Redshift
• OpenSearch
• HTTP Endpoints
• Datadog
• Splunk
• ElasticSearch

Question 15

How does scaling differ between Kinesis Data Firehose and Kinesis Data Streams?

Answer 15

• Kinesis Data Firehose scales automatically
• Kinesis Data Streams requires manual scaling through shards

Question 16

What are the primary use cases for Kinesis Data Firehose?

Answer 16

• Persisting data from Kinesis Data Streams
• Transforming and storing data in different formats
• Delivering data to supported destinations

Question 16

How do replay capabilities differ between Kinesis Data Firehose and Kinesis Data Streams?

Answer 16

• Kinesis Data Firehose doesn’t support replay
• Kinesis Data Streams allows data replay

Question 16

What distinguishes Kinesis Data Firehose and Kinesis Data Streams in terms of data persistence?

Answer 16

• Kinesis Data Firehose doesn’t support data persistence
• Kinesis Data Streams can retain data from 24 hours to 365 days

Question 17

How do consumers differ between Kinesis Data Firehose and Kinesis Data Streams?

Answer 17

• Kinesis Data Firehose is closed-ended with a single destination
• Kinesis Data Streams is open-ended, supporting multiple producers and consumers

Question 18

Can unmodified data be saved when using Lambda for transformation with Kinesis Data Firehose?

Answer 18

Yes, unmodified data can optionally be delivered to S3

Question 19

Which service is suitable if Kinesis Data Streams features are unnecessary?

Answer 19

Kinesis Data Firehose

Question 20

What AWS service combination supports real-time data transformation?

Answer 20

Kinesis Data Streams with Lambda

Question 21

Which AWS service enables real-time analysis of streaming data for actionable insights?

Answer 21

Kinesis Data Analytics

Question 22

Which AWS service allows real-time transformations, filtering, and enrichment of streaming data using SQL?

Answer 22

Kinesis Data Analytics

Question 23

Is Kinesis Data Analytics a real-time service?

Answer 23

Yes, it processes data in real-time

Question 24

What are the main use cases for Kinesis Data Analytics?

Answer 24

- Processing streaming data in real-time with SQL queries (e.g., time-series data, dashboards, or security metrics) - Performing complex data manipulations in real-time

Question 25

What data sources are supported by Kinesis Data Analytics?

Answer 25

- Kinesis Data Streams - Kinesis Data Firehose - S3 for static reference data

Question 26

What are the supported destinations for Kinesis Data Analytics?

Answer 26

- Kinesis Data Streams (real-time) - Kinesis Data Firehose (near real-time)

Question 27

How date is retrieved by consumers from Kinesis Video Streams?

Answer 27

Consumers retrieve data frame-by-frame for further analysis

Question 27

What are typical producers for Kinesis Video Streams?

Answer 27

Devices such as security cameras, smartphones, cars, drones, and sources of time-serialized data like thermal, depth, and RADAR streams

Question 27

Which AWS service automatically provisions and scales infrastructure for ingesting live video streams from millions of devices?

Answer 27

Kinesis Video Streams

Question 28

Does Kinesis Video Streams integrate with other AWS services?

Answer 28

Yes, it integrates with a range of AWS services, commonly used with Rekognition for facial recognition and S3 for data storage

Question 29

Can Kinesis Video Streams handle secure data persistence?

Answer 29

Yes, it securely persists data, with encryption both in transit and at rest

Question 30

Can data captured by Kinesis Video Streams be accessed directly from storage?

Answer 30

No, data is indexed and structured, so it can only be accessed via APIs

Question 31

How would you configure Kinesis Video Streams for two IP cameras?

Answer 31

Each camera streams data to its own video stream

Question 32

When dealing with live video streams, Real-Time Streaming Protocol (RTSP), or GStreamer, which AWS service comes to mind?

Answer 32

Kinesis Video Streams

Question 33

Which AWS service supports large-scale data ingestion by multiple producers and consumption by multiple consumers in REAL-TIME?

Answer 33

Kinesis Data Streams

Question 34

Which AWS managed service offers streaming data delivery and transformation capabilities in near-real-time?

Answer 34

Kinesis Data Firehose

Question 35

Which service processes streaming data using SQL in real-time?

Answer 35

Kinesis Data Analytics

Question 36

Can the order of data be guaranteed across multiple shards in AWS Kinesis Data Streams?

Answer 36

No, data order can only be guaranteed within a single shard

Question 37

What is the formula to calculate the initial number of shards for AWS Kinesis Data Streams?

Answer 37

num_of_shards = max(incoming_write_bandwidth_in_KiB / 1024, outgoing_read_bandwidth_in_KiB / 2048)

Question 38

What is the purpose of the partition key in AWS Kinesis Data Streams?

Answer 38

The partition key is used to distribute data records across multiple shards in a stream

Question 39

What stand-alone Java software application offers an easy way to collect and send data to Kinesis Data Streams?

Answer 39

Kinesis Agent

Question 40

How does the Kinesis Client Library (KCL) manage shard processing among multiple EC2 instances?

Answer 40

Each shard is assigned to one worker via a lease, with 10 shards, a maximum of 10 EC2 instances (workers) can be used