- Amazon Kinesis is a family of real-time data streaming and processing services provided by Amazon Web Services (AWS).
- These services enable you to ingest, process, analyse, and respond to streaming data at scale.
- Kinesis is designed to handle large volumes of real-time data from sources such as IoT devices, log files, social media, and more.
- Here’s an overview of the main services in the Amazon Kinesis family:
Amazon Kinesis Data Streams:
- Ingest and Store Real-Time Data: Kinesis Data Streams allows you to ingest and store real-time data, such as log data or clickstreams. Data is partitioned across multiple shards to enable horizontal scaling and high throughput.
- Data Processing: You can process data from Kinesis Data Streams with applications you build, such as stream processors or data aggregators.
- Use Cases: Common use cases include real-time analytics, data transformation, and monitoring of live application data.
Amazon Kinesis Data Firehose:
- Data Delivery to Destinations: Kinesis Data Firehose simplifies the process of delivering real-time data to various AWS services, including Amazon S3, Amazon Redshift, and Amazon Elasticsearch.
- Data Transformation: It can automatically transform and compress data before delivery to the chosen destination.
- Use Cases: Useful for use cases like data lakes, data warehousing, and log storage.