AWS Open Source Blog

Category: Artificial Intelligence

diagram of host machine, container, code, and datasets and checkpoints

Why use Docker containers for machine learning development?

I like prototyping on my laptop, as much as the next person. When I want to collaborate, I push my code to GitHub and invite collaborators. And when I want to run experiments and need more compute power, I rent CPU and GPU instances in the cloud, copy my code and dependencies over, and run […]

Read More
Andy Jassy giving the 2019 re:Invent keynote.

re:Cap part one – open source at re:Invent 2019

As the dust settles after another re:Invent closes, I wanted to put together a quick summary of all the open source-related announcements that happened in the run up to this year’s re:Invent and the week itself. If you are interested in open source in mobile web development, devops, containers, security, big data and data analytics, […]

Read More
Mask R-CNN Segmentation mAP

Distributed TensorFlow training using Kubeflow on Amazon EKS

Training heavy-weight deep neural networks (DNNs) on large datasets ranging from tens to hundreds of GBs often takes an unacceptably long time. Business imperatives force us to search for solutions that can reduce the training time from days to hours. Distributed data-parallel training of DNNs using multiple GPUs on multiple machines is often the right […]

Read More
GluonTS-graph.

Announcing Gluon Time Series, an Open-Source Time Series Modeling Toolkit

中文版 – Today, we announce the availability of Gluon Time Series (GluonTS), an Apache MXNet-based toolkit for time series analysis using the Gluon API. We are excited to give researchers and practitioners working with time series data access to this toolkit, which we have built for our own needs as applied scientists working on real-world […]

Read More
EKS performance - resnet50.

Best Practices for Optimizing Distributed Deep Learning Performance on Amazon EKS

中文版 – In this post, we will demonstrate how to create a fully-managed Kubernetes cluster on AWS using Amazon Elastic Container Service for Kubernetes (Amazon EKS), and how to run distributed deep learning training jobs using Kubeflow and the AWS FSx CSI driver. We then will discuss best practices to optimize machine learning training performance […]

Read More
The Seattle Spheres - photo by Deirdré Straughan.

Open Source News Roundup: April 22, 2019

中文版 Upcoming Events RailsConf (April 30-May 2 in Minneapolis, Minnesota) – Lounge & Lanyard Sponsor. Workshop on Going Serverless with Ruby on AWS Lambda by Alex Wood and Jingyi Chen. PyCon (May 1-9 in Cleveland, Ohio) – Platinum Sponsor. Come find us at Booth #439 to see how AWS <3 Python. Percona Live (May 28-30 […]

Read More
AWS SF loft sign "Code Happy"

Open Source News Roundup: June 22, 2018

Next Week! Amazon Linux Launch Event Join us for an interactive event and discover how you can innovate faster using AWS services for Amazon Linux. Senior product leaders from Amazon will announce new features, provide interactive demos, and AWS Chief Evangelist Jeff Barr will share his insights. Afterwards, join us for drinks to celebrate and […]

Read More
SAM - What's next? You!

Open Source News Roundup: April 13, 2018

Open Source News from the AWS Summit San Francisco The AWS Summit in San Francisco on April 4th saw a slew of announcements, including some in open source: SAM Implementation is now open source! “In 2016, we launched SAM and opened up the SAM specification on this Github repo to invite collaborators. We’ve loved your […]

Read More
editing open source AWS documentation

Open Source News Roundup: March 30, 2018

AWS Documentation is Now Open Source and On GitHub Earlier this year we made the AWS SDK developer guides available as GitHub repos (all found within the awsdocs organization) and invited interested parties to contribute changes and improvements in the form of pull requests. We have now added over 138 additional developer and user guides […]

Read More

Open Source News Roundup: February 9, 2018

^ The Capital One Cloud Custodian Team Community Coding at the Cloud Custodian Code Day Capital One hosted their first ever community coding event at AWS re:Invent 2017, to bring current and aspiring contributors together in single location to spend a concentrated period of time hands-on with the code. Read more about it in the […]

Read More