• Amazon Kinesis Data Firehose announces the general availability of Splunk as a destination

    Posted On: Dec 5, 2017

    Amazon Kinesis Data Firehose, the easiest way to load streaming data into data stores and analytics tools, now supports Splunk as a delivery destination. Splunk is an operational intelligence tool for analyzing machine-generated data in real-time. You can now use Kinesis Data Firehose to stream data to your Splunk cluster in real-time at any scale. This integration supports Splunk versions with HTTP Event Collector (HEC), including Splunk Enterprise and Splunk Cloud. 

  • Announcing Amazon Kinesis console enhancements

    Posted On: Nov 21, 2017

    The new Amazon Kinesis management console (see screenshot below) makes it easy for you to learn about real-time analytics and simplifies the console user experience. You can use the new visual learning tools in the console to understand how Kinesis Streams, Kinesis Firehose, and Kinesis Analytics can help you stream real-time data from various data sources to AWS, and then process, analyze, and load the data to data stores. The new console experience also includes a dashboard showing all your Kinesis resources on one screen when you log in. To get started, visit the Amazon Kinesis management console

  • New Quick Start: Build a Data Lake Foundation on the AWS Cloud with AWS Services

    Posted On: Sep 8, 2017

    This Quick Start deploys a data lake foundation that integrates Amazon Web Services (AWS) Cloud services such as Amazon Simple Storage Service (Amazon S3), Amazon Redshift, Amazon Kinesis, Amazon Athena, Amazon Elasticsearch Service (Amazon ES), and Amazon QuickSight.  

  • Amazon Kinesis Firehose is now available in Asia Pacific (Tokyo), EU (Frankfurt), and US East (Ohio) regions

    Posted On: Aug 24, 2017

    Amazon Kinesis Firehose is the easiest way to load streaming data into AWS. It can capture, transform, and load streaming data into Amazon Kinesis AnalyticsAmazon S3Amazon Redshift, and Amazon Elasticsearch Service, enabling near real-time analytics with existing business intelligence tools and dashboards you are already using today.

  • Amazon Kinesis Firehose can now read data directly from Amazon Kinesis Streams

    Posted On: Aug 18, 2017

    Amazon Kinesis Firehose is the easiest way to load streaming data into AWS. Today we have added a built-in integration that allows you to send streaming data from Kinesis Streams to Kinesis Firehose by configuring your stream as a data source to Kinesis Firehose using the console or API. You can now create and configure a Firehose delivery stream to automatically read data from your Kinesis streams and then deliver the data to destinations. This makes it easy for you to persist data in your streams to data stores such as Amazon S3, Amazon Redshift, and Amazon Elasticsearch Service. 

  • Announcing the new Amazon Kinesis Firehose management console

    Posted On: Jul 19, 2017

    Amazon Kinesis Firehose is the easiest way to prepare and load real-time streaming data into AWS. The Kinesis Firehose management console is the primary tool for creating and managing Kinesis Firehose delivery streams. Today we have launched the redesigned Kinesis Firehose management console to make it even easier to use.

  • Amazon CloudWatch Events now supports Amazon Kinesis Firehose as a target

    Posted On: Jun 16, 2017

    We are excited to announce that Amazon CloudWatch Events now supports Amazon Kinesis Firehose as a target. Amazon CloudWatch Events enables you to respond quickly to application availability issues or configuration changes that might impact performance or security by notifying you of AWS resource changes in near-real-time. You simply write rules to indicate which events are of interest to your application and what automated action to take when a rule matches an event. You can, for example, invoke AWS Lambda functions or notify an Amazon Simple Notification Service (SNS) topic.

  • Amazon Kinesis Firehose announces price reduction and tiered pricing plan

    Posted On: Apr 6, 2017

    We are excited to announce a 17% price reduction for Amazon Kinesis Firehose from $0.035 per GB to $0.029 per GB of data ingested. We have also introduced a tiered pricing plan to further reduce prices by an additional 26% to as low as $0.020 per GB of data ingested when your data volume reaches certain tier. With these two changes, you can now save up to 43% in costs when loading streaming data using Amazon Kinesis Firehose. For more information, see our pricing page.

  • Amazon Kinesis Firehose can now prepare and transform streaming data before loading it to data stores

    Posted On: Dec 21, 2016

    You can now configure Amazon Kinesis Firehose to prepare your streaming data before it is loaded to data stores. With this new feature, you can easily convert raw streaming data from your data sources into formats required by your destination data stores, without having to build your own data processing pipelines. 

  • Amazon CloudWatch adds support for evenly distributing log data from CloudWatch Logs to Amazon Kinesis

    Posted On: Dec 14, 2016

    You can now configure your Amazon Kinesis Streams subscription in CloudWatch Logs to evenly distribute log data from a log group to multiple shards. Previously log data from one log stream went to the same shard.

    To enable this feature please refer to the documentation here. To know more about CloudWatch Logs, visit the CloudWatch Logs product page.

  • Announcing the AWS Canada (Central) Region

    Posted On: Dec 8, 2016

    AWS is excited to announce immediate availability of the new Canada (Central) Region. Canada joins Northern Virginia, Ohio, Oregon, Northern California, and AWS GovCloud as the sixth AWS Region in North America and as the fifteenth worldwide, bringing the total number of AWS Availability Zones to 40 globally.

  • Test drive Amazon Kinesis Firehose using built-in sample data

    Posted On: Nov 7, 2016

    We are excited to announce the ability to test drive Amazon Kinesis Firehose from the AWS Management Console using built-in sample data.

  • Amazon Kinesis announces IAM role support in Kinesis Agent

    Posted On: Sep 16, 2016

    Amazon Kinesis Agent is a pre-built Java application that offers an easy way to collect and ingest data into Amazon Kinesis services. The agent monitors log files you specify and continuously sends new data to Amazon Kinesis Streams and Amazon Kinesis Firehose.

  • Introducing Amazon Kinesis Analytics

    Posted On: Aug 11, 2016

    We are excited to announce general availability of Amazon Kinesis Analytics, a fully managed service for continuously querying streaming data using standard SQL. With Kinesis Analytics, you can write standard SQL queries on streaming data and gain actionable insights in real-time, without having to learn any new programming skills.

  • Amazon Kinesis Firehose Supports Configurable Retry Window for Loading Data into Amazon Redshift

    Posted On: May 18, 2016

    Amazon Kinesis Firehose, the easiest way to load streaming data into AWS, now supports configurable retry duration for ingesting data into Amazon Redshift. You can now configure your Firehose delivery streams to retry the Redshift COPY for any time period up to a maximum of 7200 seconds. If the Redshift COPY command fails for any reason, Amazon Kinesis Firehose re-tries the command for the duration of the retry period you specify.

  • Amazon Kinesis Streams Introduces Time-based Shard Iterators and Shard-level Metrics

    Posted On: Apr 19, 2016

    Amazon Kinesis Streams enables you to build custom applications that process or analyze streaming data for specialized needs. Today we are adding two new features, time-based shard iterators and shard-level metrics, to make it easy to replay and manage your Amazon Kinesis streams. 

  • Amazon Kinesis Firehose adds Amazon Elasticsearch Data Ingestion and Enhanced Monitoring Features

    Posted On: Apr 19, 2016

    Amazon Kinesis Firehose, the easiest way to load streaming data into AWS, now supports Amazon Elasticsearch Service as a data delivery destination. You can now use Amazon Kinesis Firehose to stream data to your Amazon Elasticsearch domains continuously and in near real time. Amazon Kinesis Firehose automatically scales to match the throughput of your data and handles all the underlying stream management. For more information, see the Amazon Kinesis Firehose website and developer guide.

  • Amazon Kinesis Agent Now Supports Data Preprocessing Features

    Posted On: Apr 11, 2016

    Amazon Kinesis Agent is a pre-built Java application that offers an easy way to collect and send data to Amazon Kinesis Streams and Amazon Kinesis Firehose. The agent monitors a set of files for new data and continuously sends it to Amazon Kinesis Streams or Amazon Kinesis Firehose.

  • Amazon Kinesis Firehose announces AWS CloudTrail Support

    Posted On: Mar 17, 2016

    Amazon Kinesis Firehose, the easiest way to load streaming data into AWS, now supports auditing your API calls using AWS CloudTrail. AWS CloudTrail records AWS API calls for your account and delivers the log files to you. For more details, see Logging Amazon Kinesis Firehose API calls Using AWS CloudTrail.

     

    To get started with Amazon Kinesis Firehose, please visit our website and Developer Guide.

  • Amazon Kinesis Streams now available in South America (Sao Paulo) Region

    Posted On: Feb 24, 2016

    Amazon Kinesis Streams enables you to build custom applications that process or analyze streaming data for specialized needs. You can now use Amazon Kinesis Streams from the South America (Sao Paulo) Region, in addition to US East (Northern Virginia), US West (Oregon), US West (Northern California), EU (Ireland), EU (Frankfurt), Asia Pacific (Singapore), Asia Pacific (Tokyo), Asia Pacific (Sydney), and Asia Pacific (Seoul) Regions. You can get pricing information for all the regions from our pricing page.

  • Amazon Kinesis Streams Extended Data Retention

    Posted On: Oct 7, 2015

    Amazon Kinesis, which we are now calling Amazon Kinesis Streams, stores incoming data for a period of 24 hours by default. Amazon Kinesis Streams can now retain your streaming data for up to 7 days. You can dynamically configure the data retention period through an API call. For more information about extended data retention, visit Changing Data Retention Period. For extended data retention pricing, visit Amazon Kinesis Pricing.

    Amazon Kinesis Streams is a managed service that enables you to build custom applications that process or analyze streaming data for specialized needs. Amazon Kinesis Streams can continuously capture and store terabytes of data per hour from hundreds of thousands of sources, and make it available for your stream processing applications. To learn more, see the Amazon Kinesis Streams website.

  • Introducing Amazon Kinesis Firehose

    Posted On: Oct 7, 2015

    Two years ago we introduced Amazon Kinesis, which we now call Amazon Kinesis Streams, to allow customers to build applications that collect, process, and analyze streaming data with very high throughput. Many customers use Amazon Kinesis Streams to capture streaming data and load it into Amazon S3 or Amazon Redshift. Until now, this required customers to manage the Amazon Kinesis data streams and write custom code to load the data. We are now introducing Amazon Kinesis Firehose, a fully managed service that makes this as easy as an API call.

    Amazon Kinesis Firehose is the easiest way to load streaming data into AWS. It can capture and automatically load streaming data into Amazon S3 and Amazon Redshift, enabling near real-time analytics with existing business intelligence tools and dashboards you’re already using today. It is a fully managed service that automatically scales to match the throughput of your data and requires no ongoing administration. It can also batch, compress, and encrypt the data before loading it, minimizing the amount of storage used at the destination and increasing security. You can easily create a Firehose delivery stream from the AWS Management Console, configure it with a few clicks, and start sending data to the stream from hundreds of thousands of data sources to be loaded continuously to AWS – all in just a few minutes.

    With Amazon Kinesis Firehose, you only pay for the amount of data you transmit through the service. There is no minimum fee or setup cost.

    Amazon Kinesis Firehose is currently available in the following AWS Regions: N. Virginia, Oregon, and Ireland. To learn more about Amazon Kinesis Firehose, see our website, this blog post, and the documentation. To get started with Amazon Kinesis Firehose, visit the AWS Management Console.

  • Amazon Kinesis Server-side Timestamp

    Posted On: Sep 23, 2015

    Amazon Kinesis is a fully managed service for real-time processing of streaming data at massive scale. Amazon Kinesis can continuously capture and store terabytes of data per hour from hundreds of thousands of sources.

  • Amazon Kinesis announces PUT pricing change, 1MB record support, and the Kinesis Producer Library

    Posted On: Jun 2, 2015

    Amazon Kinesis is a fully managed service for real-time processing of streaming data at a massive scale. Amazon Kinesis can continuously capture and store terabytes of data per hour from hundreds of thousands of sources.

    The Amazon Kinesis team has announced PUT pricing change and two new capabilities.

    Effective June 1, 2015, Amazon Kinesis replaces the “PUT Record” pricing dimension with “PUT Payload Unit”. After the change, records smaller than 25KB receive a 50% reduction on the PUT price. For more information, please visit Amazon Kinesis Pricing.

    Amazon Kinesis raises the record size limit from 50KB to 1MB. For more information, please visit Amazon Kinesis Limits.

    Amazon Kinesis also releases the Kinesis Producer Library (KPL), an easy-to-use and highly configurable library that helps send data to Amazon Kinesis streams. For more information, please visit please visit Kinesis Producer Library.

    For more information about Amazon Kinesis, please visit our Web Page and Developer Guide.

  • Amazon Kinesis Consumer Position Metric

    Posted On: May 19, 2015

    Amazon Kinesis is a fully managed service for real-time processing of streaming data at massive scale. Amazon Kinesis can continuously capture and store terabytes of data per hour from hundreds of thousands of sources. 

  • Amazon Kinesis Client Library for Node.js Developers

    Posted On: Mar 26, 2015

    Amazon Kinesis is a fully managed service for real-time processing of streaming data at massive scale. Amazon Kinesis can continuously capture and store terabytes of data per hour from hundreds of thousands of sources.

  • Introducing Amazon Cognito Streams: Automatically stream user identity data to Amazon Kinesis

    Posted On: Mar 4, 2015

    The Amazon Cognito Streams feature allows you to automatically stream user identity data from Amazon Cognito to Amazon Kinesis. By streaming user identity data to Amazon Kinesis, you can do real-time processing, create powerful dashboards and gain insights about your user data stored in Amazon Cognito. You can also move this data from Amazon Kinesis to other services such as Amazon S3, Amazon Redshift, and Amazon DynamoDB for storage.

    You can enable this feature from your Amazon Cognito console. To learn more, please visit our blog.

  • Amazon Kinesis Propagation Delay Reduction

    Posted On: Mar 3, 2015

    Amazon Kinesis is a fully managed service for real-time processing of streaming data at massive scale. Amazon Kinesis can continuously capture and store terabytes of data per hour from hundreds of thousands of sources.

    Amazon Kinesis team has announced sub-second record propagation delay for all customers at no additional cost. All new and existing Kinesis streams will observe significantly reduced end-to-end record propagation delay without requiring any additional configuration.

    For more information about Amazon Kinesis, please visit our Web Page and Developer Guide.

    The Amazon Kinesis Team

  • Amazon Kinesis now available in US West (Northern California) Region

    Posted On: Jan 26, 2015

    Amazon Kinesis is a fully managed service for real-time processing of streaming data at massive scale. Amazon Kinesis can continuously capture and store terabytes of data per hour from hundreds of thousands of sources. Developers can write stream processing applications with the Kinesis Client Library that take action on real-time data such as web site click-streams, financial transaction data, social media feeds, IT logs, location-tracking events, and more. Amazon Kinesis-enabled applications can power real-time dashboards, generate alerts, drive real-time business decisions such as changing pricing and advertising strategies, or emit data to other big data services such as Amazon Simple Storage Service (Amazon S3), Amazon Elastic Map Reduce (Amazon EMR), and Amazon Redshift.

  • Amazon Kinesis Client Library for Ruby Developers

    Posted On: Jan 12, 2015

    Amazon Kinesis is a fully managed service for real-time processing of streaming data at massive scale. Amazon Kinesis can continuously capture and store terabytes of data per hour from hundreds of thousands of sources.

  • New PutRecords API in Amazon Kinesis to Enable Batch Data Records Input

    Posted On: Dec 4, 2014

    Amazon Kinesis is a fully managed service for real-time processing of streaming data at massive scale. Amazon Kinesis can continuously capture and store terabytes of data per hour from hundreds of thousands of sources.