Posted On: Sep 11, 2014

The Amazon Kinesis team has released an update to the Kinesis Connector Library that enables emitting data to Elasticsearch clusters. Using the connector library, developers can easily write an application that loads streaming data from Kinesis into an Elasticsearch cluster continuously, and reliably at scale.

Amazon Kinesis is a fully managed service for real-time processing of streaming data at massive scale. Using Amazon Kinesis, developers can continuously capture, and store terabytes of data an hour from hundreds of thousands of sources including web site click-streams, financial transaction data, social media feeds, IT logs, location-tracking events, and more. Developers can write stream processing applications with the Kinesis Client Library that take action on real-time data, and power real-time dashboards, generate alerts, implement dynamic pricing, and advertising strategies, or even emit data to other big data services such as Amazon Simple Storage Service (Amazon S3), Amazon Elastic Map Reduce (Amazon EMR), or Amazon Redshift.

The Amazon Kinesis Connector Library helps developers integrate Amazon Kinesis with other AWS services. The latest update to the library provides a connector for ElasticSearch, in addition to Amazon DynamoDB, Amazon Redshift, and Amazon S3. The library also includes sample connectors of each type, plus Apache Ant build files for running the samples.

For more information about Amazon Kinesis, please visit the product detail page, where you can learn more and watch a short introductory video that will explain the service. Finally, you can also get started with the service using the AWS Management Console.