AWS Big Data Blog

Yuzhou Sun

Author: Yuzhou Sun

Accelerating Spark queries with Iceberg materialized views

Accelerating Spark queries with Iceberg materialized views

Accelerate slow, repetitive Apache Spark analytical queries on Apache Iceberg tables without rewriting any SQL. This post shows how automatic query rewrite in Amazon EMR and AWS Glue uses Iceberg materialized views in the AWS Glue Data Catalog to transparently substitute matching query plans, and how to design materialized views for the best speedup.