Posted On: Sep 14, 2023
AWS Glue Streaming ETL now supports the Amazon Kinesis Data Streams (KDS) enhanced fan-out feature for Kinesis event sources. Enhanced fan-out allows developers to scale up the number of stream consumers (applications reading data from a stream in real-time) by offering each stream consumer its own read throughput.
Amazon Kinesis Data Streams (KDS) enhanced fan-out feature provides stream consumers with their own 2MB/second read throughput per shard. Starting today, AWS Glue streaming supports Enhanced Fan-Out mode, enabling customers to scale effectively, enhance the performance of their Streaming ETL jobs, and mitigate Kinesis throttling issues that arise when multiple consumers subscribe to the stream.
To learn more, visit our documentation page. This feature is available in all commercial AWS Regions where AWS Glue is available.