Amazon Web Services

In this AWS re:Invent 2023 session, Netflix engineers Ashwin Kayyoor and Rakesh Veeramacheneni share their journey of modernizing Netflix's massive data lake using Apache Iceberg. They discuss the challenges of managing an exabyte-scale data warehouse and the transition from a Hive-based system to an Iceberg-only architecture. The presentation covers the development of custom tooling, ecosystem services, and unique features like secure Iceberg tables and the Iceberg REST catalog. The speakers detail the migration process, including strategies to minimize data movement and user friction while ensuring business continuity. They also highlight the benefits of Iceberg, such as ACID transactions, rich metadata layers, and improved query performance. The talk provides valuable insights for organizations looking to scale their data infrastructure and leverage open-source table formats for efficient data management.

customer-stories
product-information
skills-and-how-to
media-and-entertainment
data
Show 7 more

Up Next

VideoThumbnail
5:35

AWS WAF - Web Application Firewall protect your web applications from common web exploits

Jun 26, 2025
VideoThumbnail
16:03

Tọa đàm với anh Hiếu Trần - Co-founder của NAB Studio

Jun 26, 2025
VideoThumbnail
18:40

Thiết kế hạ tầng mạng chung trong môi trường sử dụng nhiều AWS account (Level 200)

Jun 26, 2025
VideoThumbnail
7:59

Triển khai và vận hành ứng dụng container trên môi trường nhiều AWS account (Level 300)

Jun 26, 2025
VideoThumbnail
7:06

Sử dụng Amazon S3 như thế nào? (Level 100)

Jun 26, 2025