What does this AWS Solutions Implementation do?

The AWS Streaming Data Solution for Amazon Kinesis automatically configures the AWS services necessary to easily capture, store, process, and deliver streaming data. This solution helps you solve real-time streaming use cases, for example, capturing high volume application logs, analyzing clickstream data, continuously delivering to a data lake, and more. To provide flexibility to adapt to different use cases and business needs, this solution offers four AWS CloudFormation templates. Each template enables you to combine different components and extend them to meet your needs. You can use this solution to test new service combinations as the basis for your production environment, or to improve existing applications.

This solution shortens your development time by removing or reducing the need for you to: model and provision resources using AWS CloudFormation; set up Amazon CloudWatch alarms, dashboards, and logging; and manually implement streaming data best practices in AWS. This solution is data and logic agnostic, enabling you to start with boilerplate code and quickly start customizing. After deployment, you can use the solution’s monitoring capabilities to easily transition to production.

The AWS Streaming Data Solution for Amazon Kinesis uses templates where data flows through producers, streaming storage, consumers, and destinations. Producers continuously generate data and send it to streaming storage where it is durably captured and made available for processing by a data consumer. Data consumers process the data and then send it to a destination.

AWS Solutions Implementation overview

The diagrams below present the four AWS CloudFormation templates that you can automatically deploy using the solution's implementation guide.

  • Option 1
  • Option 2
  • Option 3
  • Option 4

Features

Automated configurations

Automatically configure the AWS services necessary to easily capture, store, process, and deliver streaming data.

Flexibility

To provide flexibility to adapt to different use cases and business needs, this solution offers four AWS CloudFormation templates. You can use this solution to test new service combinations as the basis for your production environment, or to improve a existing applications.

Real-time streaming use cases

Capture high volume application logs, analyze clickstream data, continuously deliver to a data lake, and more.

Data and logic agnostic

Quickly customize the solution’s boilerplate code. After deployment, easily transition to production with the solution’s monitoring capabilities using Amazon CloudWatch.
Build icon
Deploy a Solution yourself

Browse our library of AWS Solutions Implementations to get answers to common architectural problems.

Learn more 
Find an APN partner
Find an APN Partner

Find AWS certified consulting and technology partners to help you get started.

Learn more 
Explore icon
Explore Solutions Consulting Offers

Browse our portfolio of Consulting Offers to get AWS-vetted help with solution deployment.

Learn more