Kinesis Data Streams

Kinesis Data Streams (KDS) is a massively scalable and durable real-time data streaming service.
KDS can continuously capture gigabytes of data per second from hundreds of thousands of sources.
You can use a Lambda function to process records in KDS.
By default, Lambda invokes your function as soon as records are available in the stream.
Lambda can process up to 10 batches in each shard simultaneously.
If you increase the number of concurrent batches per shard, Lambda still ensures in-order processing at the partition-key level.
With Kinesis Data Firehose, you can't set a Lambda function as its destination but you can write Lambda functions and integrate it with Kinesis Data Firehose to request additional, customized processing of the data before it is sent downstream.
- This service is used for the processing of stream data and not actual data consumption.

Last updated 4 years ago

Was this helpful?

Kinesis Data Streams (KDS) is a massively scalable and durable real-time data streaming service.
KDS can continuously capture gigabytes of data per second from hundreds of thousands of sources.
You can use a Lambda function to process records in KDS.
By default, Lambda invokes your function as soon as records are available in the stream.
Lambda can process up to 10 batches in each shard simultaneously.
If you increase the number of concurrent batches per shard, Lambda still ensures in-order processing at the partition-key level.
With Kinesis Data Firehose, you can't set a Lambda function as its destination but you can write Lambda functions and integrate it with Kinesis Data Firehose to request additional, customized processing of the data before it is sent downstream.
- This service is used for the processing of stream data and not actual data consumption.

Last updated 4 years ago

Was this helpful?