What's New in Amazon Kinesis

You can now encrypt data in your Amazon Kinesis streams using server-side encryption and AWS Key Management Service (KMS) keys. Server-side encryption makes it easy to meet strict data management requirements by encrypting your data at rest within Kinesis Streams.

We are excited to announce that Amazon CloudWatch Events now supports Amazon Kinesis Firehose as a target. Amazon CloudWatch Events enables you to respond quickly to application availability issues or configuration changes that might impact performance or security by notifying you of AWS resource changes in near-real-time. You simply write rules to indicate which events are of interest to your application and what automated action to take when a rule matches an event. You can, for example, invoke AWS Lambda functions or notify an Amazon Simple Notification Service (SNS) topic.

We are excited to announce a 17% price reduction for Amazon Kinesis Firehose from $0.035 per GB to $0.029 per GB of data ingested. We have also introduced a tiered pricing plan to further reduce prices by an additional 26% to as low as $0.020 per GB of data ingested when your data volume reaches certain tier. With these two changes, you can now save up to 43% in costs when loading streaming data using Amazon Kinesis Firehose. For more information, see our pricing page.

You can now configure Amazon Kinesis Firehose to prepare your streaming data before it is loaded to data stores. With this new feature, you can easily convert raw streaming data from your data sources into formats required by your destination data stores, without having to build your own data processing pipelines. 

You can now configure your Amazon Kinesis Streams subscription in CloudWatch Logs to evenly distribute log data from a log group to multiple shards. Previously log data from one log stream went to the same shard.

To enable this feature please refer to the documentation here. To know more about CloudWatch Logs, visit the CloudWatch Logs product page.

AWS is excited to announce immediate availability of the new Canada (Central) Region. Canada joins Northern Virginia, Ohio, Oregon, Northern California, and AWS GovCloud as the sixth AWS Region in North America and as the fifteenth worldwide, bringing the total number of AWS Availability Zones to 40 globally.

Amazon Kinesis Streams enables you to capture, store, and analyze terabytes of data per hour from clickstreams, financial transactions, social media feeds, and more. Starting today, you can use the new UpdateShardCount feature in the AWS Management console or AWS CLI to to scale your streams up and down automatically to match your data volume and processing needs in real time. For example, you can call UpdateShardCount from an AWS Lambda function to automatically scale the shard capacity in your stream in response to an Amazon CloudWatch alarm or Amazon CloudWatch metric. For more information, see UpdateShardCount in the Amazon Kinesis Streams Service API Reference.

Amazon Kinesis Streams enables you to build custom applications that process or analyze streaming data for specialized needs. We have added new functionality to the Amazon Kinesis Streams management console and made it easier to use. You can now choose a custom data retention period between 1 to 7 days for your streams, and enable shard level Amazon CloudWatch metrics using the console. The console also now has a simpler user interface. For example, you can create a new stream in just one step and get started with Amazon Kinesis Streams in minutes. For more information, see the Amazon Kinesis Streams developer guide. 

We are excited to announce the ability to test drive Amazon Kinesis Firehose from the AWS Management Console using built-in sample data.

Amazon Kinesis Agent is a pre-built Java application that offers an easy way to collect and ingest data into Amazon Kinesis services. The agent monitors log files you specify and continuously sends new data to Amazon Kinesis Streams and Amazon Kinesis Firehose.

We are excited to announce general availability of Amazon Kinesis Analytics, a fully managed service for continuously querying streaming data using standard SQL. With Kinesis Analytics, you can write standard SQL queries on streaming data and gain actionable insights in real-time, without having to learn any new programming skills.

Amazon Kinesis Firehose, the easiest way to load streaming data into AWS, now supports configurable retry duration for ingesting data into Amazon Redshift. You can now configure your Firehose delivery streams to retry the Redshift COPY for any time period up to a maximum of 7200 seconds. If the Redshift COPY command fails for any reason, Amazon Kinesis Firehose re-tries the command for the duration of the retry period you specify.

Amazon Kinesis Streams enables you to build custom applications that process or analyze streaming data for specialized needs. Today we are adding two new features, time-based shard iterators and shard-level metrics, to make it easy to replay and manage your Amazon Kinesis streams. 

Amazon Kinesis Firehose, the easiest way to load streaming data into AWS, now supports Amazon Elasticsearch Service as a data delivery destination. You can now use Amazon Kinesis Firehose to stream data to your Amazon Elasticsearch domains continuously and in near real time. Amazon Kinesis Firehose automatically scales to match the throughput of your data and handles all the underlying stream management. For more information, see the Amazon Kinesis Firehose website and developer guide.

Amazon Kinesis Agent is a pre-built Java application that offers an easy way to collect and send data to Amazon Kinesis Streams and Amazon Kinesis Firehose. The agent monitors a set of files for new data and continuously sends it to Amazon Kinesis Streams or Amazon Kinesis Firehose.

Amazon Kinesis Firehose, the easiest way to load streaming data into AWS, now supports auditing your API calls using AWS CloudTrail. AWS CloudTrail records AWS API calls for your account and delivers the log files to you. For more details, see Logging Amazon Kinesis Firehose API calls Using AWS CloudTrail.

 

To get started with Amazon Kinesis Firehose, please visit our website and Developer Guide.

Amazon Kinesis Streams enables you to build custom applications that process or analyze streaming data for specialized needs. You can now use Amazon Kinesis Streams from the South America (Sao Paulo) Region, in addition to US East (Northern Virginia), US West (Oregon), US West (Northern California), EU (Ireland), EU (Frankfurt), Asia Pacific (Singapore), Asia Pacific (Tokyo), Asia Pacific (Sydney), and Asia Pacific (Seoul) Regions. You can get pricing information for all the regions from our pricing page.

Amazon Kinesis, which we are now calling Amazon Kinesis Streams, stores incoming data for a period of 24 hours by default. Amazon Kinesis Streams can now retain your streaming data for up to 7 days. You can dynamically configure the data retention period through an API call. For more information about extended data retention, visit Changing Data Retention Period. For extended data retention pricing, visit Amazon Kinesis Pricing.

Amazon Kinesis Streams is a managed service that enables you to build custom applications that process or analyze streaming data for specialized needs. Amazon Kinesis Streams can continuously capture and store terabytes of data per hour from hundreds of thousands of sources, and make it available for your stream processing applications. To learn more, see the Amazon Kinesis Streams website.

Two years ago we introduced Amazon Kinesis, which we now call Amazon Kinesis Streams, to allow customers to build applications that collect, process, and analyze streaming data with very high throughput. Many customers use Amazon Kinesis Streams to capture streaming data and load it into Amazon S3 or Amazon Redshift. Until now, this required customers to manage the Amazon Kinesis data streams and write custom code to load the data. We are now introducing Amazon Kinesis Firehose, a fully managed service that makes this as easy as an API call.

Amazon Kinesis Firehose is the easiest way to load streaming data into AWS. It can capture and automatically load streaming data into Amazon S3 and Amazon Redshift, enabling near real-time analytics with existing business intelligence tools and dashboards you’re already using today. It is a fully managed service that automatically scales to match the throughput of your data and requires no ongoing administration. It can also batch, compress, and encrypt the data before loading it, minimizing the amount of storage used at the destination and increasing security. You can easily create a Firehose delivery stream from the AWS Management Console, configure it with a few clicks, and start sending data to the stream from hundreds of thousands of data sources to be loaded continuously to AWS – all in just a few minutes.

With Amazon Kinesis Firehose, you only pay for the amount of data you transmit through the service. There is no minimum fee or setup cost.

Amazon Kinesis Firehose is currently available in the following AWS Regions: N. Virginia, Oregon, and Ireland. To learn more about Amazon Kinesis Firehose, see our website, this blog post, and the documentation. To get started with Amazon Kinesis Firehose, visit the AWS Management Console.

Amazon Kinesis is a fully managed service for real-time processing of streaming data at massive scale. Amazon Kinesis can continuously capture and store terabytes of data per hour from hundreds of thousands of sources.

Amazon Kinesis is a fully managed service for real-time processing of streaming data at a massive scale. Amazon Kinesis can continuously capture and store terabytes of data per hour from hundreds of thousands of sources.

The Amazon Kinesis team has announced PUT pricing change and two new capabilities.

Effective June 1, 2015, Amazon Kinesis replaces the “PUT Record” pricing dimension with “PUT Payload Unit”. After the change, records smaller than 25KB receive a 50% reduction on the PUT price. For more information, please visit Amazon Kinesis Pricing.

Amazon Kinesis raises the record size limit from 50KB to 1MB. For more information, please visit Amazon Kinesis Limits.

Amazon Kinesis also releases the Kinesis Producer Library (KPL), an easy-to-use and highly configurable library that helps send data to Amazon Kinesis streams. For more information, please visit please visit Kinesis Producer Library.

For more information about Amazon Kinesis, please visit our Web Page and Developer Guide.

Amazon Kinesis is a fully managed service for real-time processing of streaming data at massive scale. Amazon Kinesis can continuously capture and store terabytes of data per hour from hundreds of thousands of sources. 

Amazon Kinesis is a fully managed service for real-time processing of streaming data at massive scale. Amazon Kinesis can continuously capture and store terabytes of data per hour from hundreds of thousands of sources.

The Amazon Cognito Streams feature allows you to automatically stream user identity data from Amazon Cognito to Amazon Kinesis. By streaming user identity data to Amazon Kinesis, you can do real-time processing, create powerful dashboards and gain insights about your user data stored in Amazon Cognito. You can also move this data from Amazon Kinesis to other services such as Amazon S3, Amazon Redshift, and Amazon DynamoDB for storage.

You can enable this feature from your Amazon Cognito console. To learn more, please visit our blog.

Amazon Kinesis is a fully managed service for real-time processing of streaming data at massive scale. Amazon Kinesis can continuously capture and store terabytes of data per hour from hundreds of thousands of sources.

Amazon Kinesis team has announced sub-second record propagation delay for all customers at no additional cost. All new and existing Kinesis streams will observe significantly reduced end-to-end record propagation delay without requiring any additional configuration.

For more information about Amazon Kinesis, please visit our Web Page and Developer Guide.

The Amazon Kinesis Team

Amazon Kinesis is a fully managed service for real-time processing of streaming data at massive scale. Amazon Kinesis can continuously capture and store terabytes of data per hour from hundreds of thousands of sources. Developers can write stream processing applications with the Kinesis Client Library that take action on real-time data such as web site click-streams, financial transaction data, social media feeds, IT logs, location-tracking events, and more. Amazon Kinesis-enabled applications can power real-time dashboards, generate alerts, drive real-time business decisions such as changing pricing and advertising strategies, or emit data to other big data services such as Amazon Simple Storage Service (Amazon S3), Amazon Elastic Map Reduce (Amazon EMR), and Amazon Redshift.

Amazon Kinesis is a fully managed service for real-time processing of streaming data at massive scale. Amazon Kinesis can continuously capture and store terabytes of data per hour from hundreds of thousands of sources.

Amazon Kinesis is a fully managed service for real-time processing of streaming data at massive scale. Amazon Kinesis can continuously capture and store terabytes of data per hour from hundreds of thousands of sources.