AWS Open Source Blog

Category: Open Source

Amazon's Exabyte-Scale Migration from Apache Spark to Ray on Amazon EC2

Amazon’s Exabyte-Scale Migration from Apache Spark to Ray on Amazon EC2

Large-scale, distributed compute framework migrations are not for the faint of heart. There are backwards-compatibility constraints to maintain, performance expectations to meet, scalability limits to overcome, and the omnipresent risk of introducing breaking changes to production. This all becomes especially troubling if you happen to be migrating away from something that successfully processes exabytes of […]

Getting Started with Cilium Service Mesh on Amazon EKS

Getting Started with Cilium Service Mesh on Amazon EKS

Cilium is an open source solution for providing, securing, and observing network connectivity between workloads, powered by the revolutionary kernel technology called extended Berkeley Packet Filter (eBPF). eBPF enables the dynamic insertion of security, visibility, and networking logic into the Linux kernel. Cilium provides high-performance networking, advanced load balancing, transparent encryption, and observability. Cilium was […]

Build More Sustainable AWS Workloads with the Sustainability Scanner

Build More Sustainable AWS Workloads with the Sustainability Scanner

Sustainability Scanner is an open source tool designed to help customers create a more sustainable infrastructure on AWS by evaluating your infrastructure as code against a set of sustainability best practices and suggested improvements to apply to your code.