AWS Big Data Blog

Tag: Apache Parquet

Load data incrementally and optimized Parquet writer with AWS Glue

October 2022: This post was reviewed for messaging and accuracy. AWS Glue provides a serverless environment to prepare (extract and transform) and load large amounts of datasets from a variety of sources for analytics and data processing with Apache Spark ETL jobs. The first post of the series, Best practices to scale Apache Spark jobs […]