Introducing AWS Data Streaming Data Solution for Amazon Kinesis

Posted on: Sep 1, 2020

The AWS Streaming Data Solution for Amazon Kinesis is an AWS Solutions Implementation that provides an automated configuration of the AWS services necessary to easily capture, store, process, and deliver streaming data. This solution helps you solve for several real-time streaming use cases like capturing high volume application logs, analyzing clickstream data, continuously delivering to a data lake to name a few. To provide flexibility to adapt to different use cases and business needs, this solution offers two deployment options. Developers can use this solution to test new service combinations as the basis for their production environment, or to improve an existing application they have already implemented.

Developers want to build a high performance, security compliant, and easy-to-manage streaming solution. This solution shortens your development time by reducing the need for you to: model and provision resources using AWS CloudFormation; set up Amazon CloudWatch alarms, dashboards, and logging; and manually implement streaming data best practices in AWS. 

This solution provides two AWS CloudFormation templates, both of which use Amazon Kinesis Data Streams for streaming storage. One template uses Amazon API Gateway for ingestion and AWS Lambda as a consumer. The second template uses direct ingestion to Kinesis Data Streams from Amazon Elastic Compute Cloud (Amazon EC2), Amazon Kinesis Data Analytics as a consumer, and Amazon Simple Storage Service (Amazon S3) as a storage destination. To learn more about AWS Data Streaming Solution for Amazon Kinesis, see the AWS Solutions Implementation webpage and the GitHub repository.

Additional AWS Solutions are available on the AWS Solutions Implementation webpage, where customers can browse solutions by product category or industry to find AWS-vetted, automated, turnkey reference implementations that address specific business needs.