AWS Big Data Blog

Jerome Rajan

Author: Jerome Rajan

Handle fast-changing reference data in an AWS Glue streaming ETL job

Streaming ETL jobs in AWS Glue can consume data from streaming sources such as Amazon Kinesis and Apache Kafka, clean and transform those data streams in-flight, as well as continuously load the results into Amazon Simple Storage Service (Amazon S3) data lakes, data warehouses, or other data stores. The always-on nature of streaming jobs poses […]