AWS Open Source Blog

Recap: Open Source at re:Invent 2018

AWS re:Invent 2018 header


Though it seems like a lifetime already, re:Invent 2018 took place only three weeks ago. We knew that a lot of open source would be happening at re:Invent, and we even told you about some of it in advance. 😉 But there were multiple open source announcements during re:Invent for which, of course, we couldn’t spoil the surprise! In case you missed any, here’s a recap.

AWS RoboMaker

The first launch announcement, made at Midnight Madness, was AWS RoboMaker – Develop, Test, Deploy, and Manage Intelligent Robotics Apps. RoboMaker uses and extends the open source Robot Operating System (ROS). In an interview about The Open Source Robot Operating System (ROS) and AWS RoboMaker, Brian Gerkey, CEO and co-founder of Open Robotics, gave Adrian Cockcroft some history and an overview of current development on ROS, how AWS is supporting these efforts, and how you can get involved and contribute.

For a deeper dive, and a customer case study, watch the re:Invent session Announcing AWS RoboMaker: A New Cloud Robotics Service.


An announcement that generated a lot of excitement was Firecracker – Lightweight Virtualization for Serverless Computing, which we also open sourced.

Amazon SageMaker Neo

This new capability of Amazon SageMaker enables machine learning models to train once and run anywhere in the cloud and at the edge, with optimal performance, without needing to tune a model for a specific hardware architecture. Amazon SageMaker Neo has been released as open source code under the Apache Software License, enabling hardware vendors to customize it for their processors and devices.

AWS Amplify Console

Also announced was a new console for AWS Amplify. If you’re not familiar with it, AWS Amplify is a comprehensive library for building sophisticated cloud-powered apps – and it’s open source.

AWS Security Hub

AWS Security Hub, announced during Andy Jassy’s keynote, “gives you a comprehensive view of your high-priority security alerts and compliance status across AWS accounts.” As part of that announcement, David Filiatrault, Senior Consultant in AWS Professional Services, created and open sourced Cloud Custodian Integration with AWS Security Hub, with a primary goal of supporting AWS customers already using Cloud Custodian. But we would also encourage other open source security and compliance assessment projects to use this as an example of how to integrate with AWS Security Hub.

AWS AppMesh

AWS App Mesh, a service mesh for microservices on AWS, provides a highly-available control plane for Envoy, an open source CNCF-graduated project.

New AWS Lambda Features and Open Source Runtimes

Two new features were announced for AWS Lambda: Lambda Layers, a way to centrally manage code and data that is shared across multiple functions, and the Lambda Runtime API, a simple interface to use any programming language, or a specific language version, for developing your functions. These make it possible to create, manage, and publish your own runtimes, and to use runtimes as layers. We’d love to see lots of runtimes developed and open sourced. To get the ball rolling, we have open sourced runtimes for C++ and Rust.

More About Open Source at AWS

In a live interview from the re:Invent Expo floor with SiliconANGLE’s theCUBE, Adrian Cockcroft spoke with Dave Vellante and David Floyer about what he and his team have been doing to help grow open source at AWS.

…and a Few More…

Some important open source announcements occurred before re:Invent, including:

AWS ParallelCluster

AWS ParallelCluster is an AWS-supported, open source cluster management tool that makes it easy for scientists, researchers, and IT administrators to deploy and manage High Performance Computing (HPC) clusters in the AWS cloud.

Amazon Corretto

In mid-November, James Gosling made a special appearance at Devoxx in Antwerp, Belgium, to announce Amazon Corretto, a No-Cost Distribution of OpenJDK with Long-Term Support.

Git Integration for Amazon SageMaker Notebooks

You can now associate GitHub, AWS CodeCommit, and any self-hosted Git repository with Amazon SageMaker notebook instances. In collaboration with the Project Jupyter community, the Amazon SageMaker team has redesigned and developed an open-source Git extension for JupyterLab, which provides an intuitive and visual way to collaborate on JupyterLab. Learn more in New Features For Amazon SageMaker: Workflows, Algorithms, and Accreditation by Dr. Matt Wood.

What Next?

So… it was a busy month – and all this came in addition to the 1600+ projects we’ve already open sourced on GitHub and elsewhere, and the projects we contribute to and make easier for customers to use. What’s coming next? Watch this space!

Deirdré Straughan

Deirdré Straughan

Deirdré has been communicating about technology, and helping others to do so, for 30 years. She has written one book (so far); edited two more (so far); produced and delivered technical training; produced hundreds of videos and live streams of technical talks; written, edited, and managed blogs; and managed events. She has been applying this skill set to cloud computing since 2010, and to open source for even longer. She joined AWS in June, 2017, as Open Source Content Lead. In this role, among other tasks, she is managing editor of the AWS Open Source blog. You can find her at @deirdres on Twitter.