Posted On: Dec 26, 2023
With zero buffering, customers can deliver data to Amazon S3, Amazon OpenSearch Service, Amazon Redshift, and third-party HTTP destinations within seconds enabling real time use cases.
Currently, Amazon Kinesis Data Firehose buffers data for at least sixty seconds before delivering it to a destination. However, many customers want faster insights from their data. With zero buffering, customers can setup a Amazon Kinesis Data Firehose stream to not buffer data before delivery, and most streams with no additional processing are delivered within five seconds. To meet lower latency use cases, zero buffering is also supported for Lambda that is used by customers for data transformation within Amazon Kinesis Data Firehose. For some use cases where zero buffering is not suitable, customers have the flexibility to choose a lower buffering interval anywhere from zero to maximum buffering interval range.
For third party destinations, before you make the change, please check with the vendor for recommended buffering settings of Kinesis Data Firehose.
Amazon Kinesis Data Firehose is the easiest way to load streaming data into AWS. To get started with Kinesis Data Firehose, visit the console and the developer guide. To learn more about zero buffering, refer to the documentation.