AWS Cloud
Get started with Data Streaming

Streaming data generated continuously by a variety of data sources such as application servers, websites, mobile apps, and IoT devices, contains information that can help you learn about what your customers, applications, and products are doing right now. Having the ability to process and analyze this data in real-time is essential for use cases such as continuously monitoring your applications to ensure high service uptime, and personalizing promotional offers and product recommendations. Real-time processing can also make other common use cases, such as website analytics and machine learning, more accurate and actionable by making data available to these applications in seconds or minutes instead of hours or days.

Amazon Web Services (AWS) provides a number options to work with streaming data. You can take advantage of the managed streaming data capabilities offered by Amazon Kinesis, or deploy and manage your own streaming data solution using Apache Kafka.

Amazon Kinesis Streams is a fully managed service that makes it easy to collect, process, and analyze real-time, streaming data so you can get timely insights and react quickly to new information. It enables you to cost effectively process streaming data at any scale, along with the flexibility to choose the tools that best suit the requirements of your application. Apache Kafka is an open-source streaming data solution that you can run on Amazon EC2 to build real-time applications.

Request support for your proof-of-concept or evaluation » 

Low Administration

Fully Managed

With Amazon Kinesis Streams, there are no servers to manage or capacity scaling cliffs to worry about, and you can focus on your applications. The Kinesis Producer Library (KPL) and the Kinesis Consumer Library (KCL) already incorporate stream processing best practices, so you don’t have to build any custom code to fine-tune your stream processing applications.

Cost Effective

Costs Less

Amazon Kinesis Streams enables you to ingest, buffer, and process streaming data more efficiently. With Amazon Kinesis Streams, you can easily scale your resources, so you never have to overprovision resources. And, you don't need an engineer on call to manage the streams. As a result, you can save on costs.

Elastically Scalable

Easily Scalable

Amazon Kinesis Streams allows you to easily scale the capacity of your streams to match the data volume with just a few clicks in the console or by making an API call.

Highly Available

Reliable

Amazon Kinesis Streams automatically replicates your data across 3 AWS availability zones, providing application reliability. You don't have to set up and configure your application for replication.

Secure

Secure

Amazon Kinesis Streams natively supports IAM and the HTTPS protocol for streaming data to help you readily secure your data and applications. Amazon Kinesis Streams provides stream and shard level metrics, so you can easily monitor your streams and automate stream management tasks.

Integrated

Integrated

Amazon Kinesis Streams is tightly integrated with other AWS services such as Amazon DynamoDB, Amazon Kinesis Analytics, AWS Lambda, AWS IoT, and open-source frameworks such as Spark and Flink. This allows you to easily process the data and load it into your data stores.

Netflix uses Kinesis

Netflix chose Amazon Kinesis Streams over Kafka to build an application monitoring system because Amazon Kinesis Streams is easy to manage and costs less. Netflix uses Amazon Kinesis Streams to monitor communications between all of its applications so it can detect and fix issues quickly, ensuring high service uptime and availability to its customers. 

Zillow uses Amazon Kinesis Streams to ingest a variety of data such as public property-records and MLS listings, and sends it to Spark on Amazon EMR, which runs machine-learning models and gives users real-time home value estimates. Zillow evaluated both Kafka and Amazon Kinesis Streams for this use case, and chose Amazon Kinesis Streams because it is fully managed and easier to scale. Read the Case Study »

Adroll migrated from Kafka to Amazon Kinesis Streams because they don't have to worry about tuning and managing the streams themselves. Watch this re:Invent 2015 break out session, in which Adi Krishnan, principal product manager of Amazon Kinesis, and Nick Barrash, software development engineer at AdRoll, discuss how AdRoll uses Amazon Kinesis for real-time applications requiring millisecond latencies. Watch re:Invent Session »


It's easy to get started with Amazon Kinesis. Just sign up for an AWS account, or if you already have one, sign in to the AWS Management Console, and launch Amazon Kinesis.

 

Get Started with Amazon Kinesis