Amazon Web Services

This video explores data processing at massive scale on Amazon EKS, featuring insights from AWS experts and Pinterest's modernization journey. It covers the benefits of running Apache Spark on Kubernetes, best practices for scalability, and how AWS's Data on EKS project helps customers build modern data platforms. The session highlights key considerations for networking, storage, compute, and observability when running data-intensive workloads on EKS. Pinterest shares their experience migrating from Hadoop to Spark on EKS, including challenges faced and wins achieved. The video concludes with detailed best practices for optimizing Spark performance on EKS at scale.

product-information
skills-and-how-to
data
analytics
containers
Show 5 more

Up Next

VideoThumbnail
1:01:07

Accelerate ML Model Delivery: Implementing End-to-End MLOps Solutions with Amazon SageMaker

Nov 22, 2024
VideoThumbnail
6:45

Grindr's Next-Gen Chat System: Leveraging AWS for Massive Scale and Security

Nov 22, 2024
VideoThumbnail
40:23

Set Up and Use Apache Iceberg Tables on Your Data Lake - AWS Virtual Workshop

Nov 22, 2024
VideoThumbnail
2:53:33

Streamlining Patch Management: AWS Systems Manager's Comprehensive Solution for Multi-Account and Multi-Region Patching Operations

Nov 22, 2024
VideoThumbnail
9:30

Deploying ASP.NET Core 6 Applications on AWS Elastic Beanstalk Linux: A Step-by-Step Guide for .NET Developers

Nov 22, 2024