AWS Open Source Blog

AWS Cloud Map service discovery for serverless applications

Microservices-based architecture helps reduce the complexity of application components, while posing a new class of problems related to the connectivity between microservices. Keeping track of all your application components, whether custom-built or managed AWS services, across multiple stages and deployments is a challenging task. AWS Cloud Map is a fully-managed service discovery tool for all […]

Read More
Amazon Corretto Duke logo.

Amazon joins the Java Community Process (JCP)

Amazon runs thousands of Java production services; both we and our customers depend heavily on  various distributions of the JDK (Java Development Kit). In 2016 we started building Amazon Corretto, our OpenJDK binary distribution, and started using it to run AWS and other Amazon services. In 2018, we open sourced Corretto and made it available […]

Read More

How AWS is helping to open source the future of robotics

Our robot overlords may not take over anytime soon, but when they do, they’ll likely be running ROS. ROS, or Robot Operating System, was launched over a decade ago to unite developers in building “a collection of tools, libraries, and conventions that aim to simplify the task of creating complex and robust robot behavior across […]

Read More

Deploying Spark jobs on Amazon EKS

UPDATE, March 2021: This blog post describes how to deploy self-managed Apache Spark jobs on Amazon EKS. AWS now provides a fully managed service with Amazon EMR on Amazon EKS. This new deployment option allows customers to automate the provisioning and management of Spark on Amazon EKS, and benefit from advanced features such as Amazon […]

Read More
Rust language logo.

AWS’ sponsorship of the Rust project

We’re really excited to announce that AWS is sponsoring the Rust programming language! Rust is designed for writing and maintaining fast, reliable, and efficient code. It has seen considerable uptake since its first stable release four years ago, with companies like Google, Microsoft, and Mozilla all using Rust. Rust has also seen lots of growth […]

Read More
AWS Open Source logo.

AWS promotional credits for open source projects

AWS has always aimed to help make technology that was historically cost-prohibitive and difficult for many organizations to adopt much more accessible to a broader audience. This applies to open source technologies as well. We help customers to run a wide variety of open source operating systems on EC2. We offer managed services for open […]

Read More
high-level architecture of the open source project for the Serverless App Repository in production.

How AWS built a production service using serverless technologies

Our customers are constantly seeking ways to increase agility and innovation in their organizations, and often reach out to us wanting to learn more about how we iterate quickly on behalf of our customers. As part of our unique culture (which Jeff Barr discusses at length in this keynote talk), we constantly explore ways to […]

Read More
Mask R-CNN Segmentation mAP

Distributed TensorFlow training using Kubeflow on Amazon EKS

Training heavy-weight deep neural networks (DNNs) on large datasets ranging from tens to hundreds of GBs often takes an unacceptably long time. Business imperatives force us to search for solutions that can reduce the training time from days to hours. Distributed data-parallel training of DNNs using multiple GPUs on multiple machines is often the right […]

Read More
Lucene in action Amazon search screenshot.

What Amazon gets by giving back to Apache Lucene

  At pretty much any scale, search is hard. It becomes dramatically harder, however, when searching at Amazon scale: think billions of products, complicated by millions of sellers constantly changing those products on a daily basis, with hundreds of millions of customers searching through that inventory at all hours. Although Amazon has powered its product […]

Read More
2019 All Things Open main page.

Join us for the Open Distro Hack Day and more at All Things Open in Raleigh, NC

Note: See the All Things Open 2018 – Conference Wrap-Up for links to slides and more! We’re excited to return to one of our favorite open source community conferences, All Things Open, taking place October 13-15 in Raleigh, NC. AWS is a Presenting Sponsor, and we have some great events lined up – please join […]

Read More