Amazon Web Services
This video explores data processing at massive scale on Amazon EKS, featuring insights from AWS experts and Pinterest's modernization journey. It covers the benefits of running Apache Spark on Kubernetes, best practices for scalability, and how AWS's Data on EKS project helps customers build modern data platforms. The session highlights key considerations for networking, storage, compute, and observability when running data-intensive workloads on EKS. Pinterest shares their experience migrating from Hadoop to Spark on EKS, including challenges faced and wins achieved. The video concludes with detailed best practices for optimizing Spark performance on EKS at scale.