Amazon Kinesis Data Streams Documentation

Collect streaming data, at scale, for near-real-time analytics.

Amazon Kinesis Data Streams (KDS) is designed to be a scalable and near-real-time data streaming service. KDS is designed to help you capture data from variegated sources such as website clickstreams, database event streams, financial transactions, social media feeds, IT logs, and location-tracking events. The data collected can be available in milliseconds to enable near-real-time analytics use cases including dashboards, anomaly detection, dynamic pricing, and more.

Benefits

Near-real-time performance

Designed to make your streaming data available to multiple real-time analytics applications, to Amazon S3, or to AWS Lambda within milliseconds of the data being collected.

Durability

The service is designed to synchronously replicate your streaming data across three Availability Zones in an AWS Region and storage of that data for up to 365 days helps to provide multiple layers of protection from data loss.

Security

Helps you meet your regulatory and compliance needs by allowing you to encrypt sensitive data within KDS, and privately access your data via your Amazon Virtual Private Cloud (VPC). Data can be encrypted at-rest by using server-side encryption and AWS KMS master keys.

Usability

Build your streaming applications using the AWS SDK, the Kinesis Client Library (KCL), connectors, and agents. Process data with built-in integrations to AWS Lambda, Amazon Kinesis Data Analytics, Amazon Kinesis Data Firehose, and AWS Glue Schema Registry.

Elasticity

Kinesis data streams are designed to scale from megabytes to terabytes per hour, and scale from thousands to millions of PUT records per second. You can dynamically adjust the throughput of your stream based on the volume of your input data.

Use cases

Log and event data collection

Kinesis Data Streams can be used to collect log and event data from sources such as servers, desktops, and mobile devices. You can then build Kinesis Applications to process the data, generate metrics, power live dashboards, and emit aggregated data into stores such as Amazon S3.

Near real-time analytics

You can have your Kinesis Applications run near real-time analytics on high frequency event data such as sensor data collected by Kinesis Data Streams, which enables you to gain insights from your data.

Mobile data capture

You can have your mobile applications push data to Kinesis Data Streams from hundreds of thousands of devices.

Gaming data feed

Kinesis Data Streams can be used to collect data about player-game interactions and feed the data into your gaming platform. With Kinesis Data Streams, you can design a game that provides engaging and dynamic experiences based on players’ actions and behaviors.

Additional Information

For additional information about service controls, security features and functionalities, including, as applicable, information about storing, retrieving, modifying, restricting, and deleting data, please see https://docs.aws.amazon.com/index.html. This additional information does not form part of the Documentation for purposes of the AWS Customer Agreement available at http://aws.amazon.com/agreement, or other agreement between you and AWS governing your use of AWS’s services.