What does this AWS Solution do?
Many Amazon Web Services (AWS) customers use streaming data to gain real-time insight into customer activity and immediate business trends. Streaming data, which is generated continuously from thousands of data sources, includes a wide variety of data such as log files from your mobile or web applications, e-commerce purchases, in-game player activity, information from social networks, financial trading floors, or geospatial services, and telemetry from connected devices. This data can help companies make well-informed decisions and proactively respond to changing business conditions.
Amazon Kinesis, a platform for streaming data on AWS, offers powerful services that make it easier to build data processing applications, load massive volumes of streaming data, and analyze it in real time.
The following section assumes basic knowledge of architecting on the AWS Cloud, streaming data, and data analysis.
AWS Solution overview
AWS offers a solution that automatically launches and configures Amazon Kinesis Streams to load streaming data, Amazon Kinesis Analytics to filter and process that data, and Amazon Kinesis Firehose to deliver the data to various data stores for search, storage, or further analytics. The diagram below presents the Streaming Analytics Pipeline architecture you can deploy in minutes using the solution's implementation guide and accompanying AWS CloudFormation template.
Real-Time Analytics with Amazon Kinesis architecture
This solution uses Amazon Kinesis Streams to load streaming data into Amazon Kinesis Analytics. An Amazon Kinesis Analytics application filters and processes the data, and puts it into Amazon Kinesis Firehose. Then, an Amazon Kinesis Firehose delivery stream delivers the analyzed data to various data stores for search, storage, or further analytics. You can choose to put your analyzed data into an Amazon S3 bucket, an Amazon Redshift cluster, an Amazon Elasticsearch Service domain, or an Amazon Kinesis stream.
If you choose to persist raw data, AWS Lambda decodes the data and puts it into Amazon Kinesis Firehose which delivers it to Amazon S3.
Real-Time Analytics with Amazon Kinesis reference implementation
Multiple External Destinations
Streaming data format
Browse our portfolio of AWS-built solutions to common architectural problems.
Find AWS certified consulting and technology partners to help you get started.
Sign-up and start exploring our services.