Amazon Web Services

This video explores data processing at massive scale on Amazon EKS, featuring insights from AWS experts and Pinterest's modernization journey. It covers the benefits of running Apache Spark on Kubernetes, best practices for scalability, and how AWS's Data on EKS project helps customers build modern data platforms. The session highlights key considerations for networking, storage, compute, and observability when running data-intensive workloads on EKS. Pinterest shares their experience migrating from Hadoop to Spark on EKS, including challenges faced and wins achieved. The video concludes with detailed best practices for optimizing Spark performance on EKS at scale.

product-information
skills-and-how-to
data
analytics
containers
Show 5 more

Up Next

VideoThumbnail
58:49

AWS Clean Rooms ML and Differential Privacy: Revolutionizing Secure Data Collaboration

Nov 22, 2024
VideoThumbnail
14:40

Amazon Aurora MySQL Zero-ETL Integration with Amazon Redshift: Public Preview Demo and Setup Guide

Nov 22, 2024
VideoThumbnail
18:11

Building Intelligent Chatbots: Integrating Amazon Lex with Bedrock Knowledge Bases for Enhanced Customer Experiences

Nov 22, 2024
VideoThumbnail
3:06

AWS IAM Identity Center: Simplifying Workforce Identity Management and Access Control Across Multiple AWS Accounts

Nov 22, 2024
VideoThumbnail
15:41

Simplifying Graph Queries with Amazon Neptune and LangChain: Harnessing AI for Intuitive Data Exploration

Nov 22, 2024