Amazon Kinesis Data Streams resources

This is a pre-built Java application that offers an easy way to collect and send data to your Amazon Kinesis data stream. You can install the agent on Linux-based server environments such as web servers, log servers, and database servers. The agent monitors certain files and continuously sends data to your data stream. Get Amazon Kinesis Agent.

This is a pre-built library that helps you easily build Amazon Kinesis Applications for reading and processing data from an Amazon Kinesis stream. This library handles complex issues such as adapting to changes in stream volume, load-balancing streaming data, coordinating distributed services, and processing data with fault-tolerance, enabling you to focus on business logic while building applications. Get Kinesis Client Library for Java | Python | Ruby | Node.js | .NET

Use AWS Streaming Data Solution for Amazon Kinesis to help you solve for real-time streaming use cases like capturing high volume application logs, analyzing clickstream data, continuously delivering to a data lake, and more.

This solution shortens your development time by days by removing or reducing the need for you to: model and provision resources using AWS CloudFormation; set up Amazon CloudWatch alarms, dashboards, and logging; and manually implement streaming data best practices in AWS. This solution is data and logic agnostic, enabling you to start with boilerplate code and quickly start customizing. After deployment, you can use the solution’s monitoring capabilities to easily transition to production.

This is an easy to use and highly configurable library that helps you put data into an Amazon Kinesis stream. This library presents a simple, asynchronous, and reliable interface that enables you to quickly achieve high producer throughput with minimal client resources. Get Kinesis Producer Library.

This is a pre-built library that helps you easily integrate Amazon Kinesis Data Streams with other AWS services and third-party tools. Amazon Kinesis Client Library (KCL) is required for using this library. The current version of this library provides connectors to Amazon DynamoDB, Amazon Redshift, Amazon S3, and Elasticsearch. The library also includes sample connectors of each type, plus Apache Ant build files for running the samples. Get Kinesis Connector Library.

This is a pre-built library that helps you easily integrate Amazon Kinesis Data Streams with Apache Storm. The current version of this library fetches data from Amazon Kinesis stream and emits it as tuples. You will add the spout to your Storm topology to leverage Amazon Kinesis Data Streams as a reliable, scalable, stream capture, storage, and replay service. Get Kinesis Storm Spout.

Learn how to build a real-time sliding-window dashboard with Amazon Kinesis Data Streams and Apache Storm.