Apache Iceberg is an open table format for storing large data sets on Amazon S3. It is a foundational tool for building transactional data lakes on S3. Iceberg support ACID transactions, compaction, and schema evolution. Query engines such as Athena, Spark, and Trino can query Iceberg tables natively using SQL.

Apache Iceberg is popular with startups as it takes away the undifferentiated heavy lifting associated with managing data in S3. In particular, it handles partitions, and compaction which is a common pain (and cost) problem. This becomes especially relevant for event stream data (either CDC from databases, or IoT event streams) as it can quickly, and automatically, add records to an Iceberg table while also mitigating the cost impact of ‘lots of small files’ on S3.

In this Immersion Day we will dive deep on Iceberg, and how it can be used on AWS to scalably, and cost effectively run analytics on your data. This workshop will be a combination of presentations and hands-on workshops.

This Immersion Day will be useful if you are running analytics workloads on large columnar-style datasets or streaming events for analytics (e.g. IoT).

Please bring your laptop to participate, and remember to bring photo ID for entry.