Amazon Kinesis Firehose is the easiest way to load streaming data into AWS. It can capture and automatically load streaming data into Amazon S3, Amazon Redshift, and Amazon Elasticsearch Service, enabling near real-time analytics with existing business intelligence tools and dashboards you’re already using today. It is a fully managed service that automatically scales to match the throughput of your data and requires no ongoing administration. It can also batch, compress, and encrypt the data before loading it, minimizing the amount of storage used at the destination and increasing security. You can easily create a Firehose delivery stream from the AWS Management Console, configure it with a few clicks, and start sending data to the stream from hundreds of thousands of data sources to be loaded continuously to AWS – all in just a few minutes.
With Amazon Kinesis Firehose, you only pay for the amount of data you transmit through the service. There is no minimum fee or setup cost.
Get started with Amazon Kinesis Firehose with this free hands-on lab tutorial.
Data Preprocessing Features in Amazon Kinesis Agent | 4/11/2016 | AWS
Building a Near Real-Time Discovery Platform with AWS | 11/18/2015 | AWS
Amazon Kinesis Firehose provides a simple way to capture and load streaming data with just a few clicks in the AWS Management Console. You can simply create a Firehose delivery stream, select the destinations, and you can start sending real-time data from hundreds of thousands of data sources simultaneously. The service takes care of stream management, including all the scaling, sharding, and monitoring, needed to continuously load the data to destinations at the intervals you specify.
Amazon Kinesis Firehose is integrated with Amazon S3, Amazon Redshift, and Amazon Elasticsearch Service. From the AWS Management Console, you can point Amazon Kinesis Firehose to an Amazon S3 bucket, Amazon Redshift table, or Amazon Elasticsearch domain. You can then use your existing analytics applications and tools to analyze streaming data.
Amazon Kinesis Firehose captures and loads data in near real-time. It loads new data into Amazon S3, Amazon Redshift, and Amazon Elasticsearch Service within 60 seconds after the data is sent to the service. As a result, you can access new data sooner and react to business and operational events faster.
With Amazon Kinesis Firehose, you can capture data continuously from connected devices such as consumer appliances, embedded sensors, and TV set-top boxes. Amazon Kinesis Firehose loads the data directly into Amazon S3, enabling you to provide your customers near real-time access to sensor data like transportation logistics data from embedded sensors in trucks and transportation vehicles. You can also configure Amazon Kinesis Firehose to load device data–such as data from solar panels and power grids, wearables, and healthcare devices–into Amazon Redshift and Amazon Elasticsearch Service, allowing your teams to monitor metrics and respond to your customer needs proactively.
You can use Amazon Kinesis Firehose to enable delivery of real-time metrics on digital marketing and advertising campaigns, enabling marketers to connect with their customers in the most effective way. You can stream billions of small messages that are compressed, encrypted, and delivered to Amazon S3. Once in Amazon S3, you can use Amazon Elastic MapReduce jobs to aggregate, filter, and process the data, and refresh campaign performance dashboards in near real-time.
Using Amazon Kinesis Firehose, you can have your mobile applications push data directly to AWS data stores such as Amazon S3 and Amazon Redshift simultaneously from hundreds of thousands of devices, making the data available to your existing analytics tools and dashboards shortly after it is generated on the mobile devices. You can also send the data to Amazon Elasticsearch Service using Amazon Kinesis Firehose and enable your users to explore and search the data using Elasticsearch’s search API and Kibana, which is an open-source data visualization platform.