AWS Open Source Blog

Category: Artificial Intelligence

AutoGluon how-to tutorial

Machine learning with AutoGluon, an open source AutoML library

If you work in data science, you might think that the hardest thing about machine learning is not knowing when you’ll be done. You start with a problem, a dataset, and an idea about how to solve it, but you never know whether your approach is going to work until later, after you’ve wasted time. […]

diagram of host machine, container, code, and datasets and checkpoints

Why use Docker containers for machine learning development?

I like prototyping on my laptop, as much as the next person. When I want to collaborate, I push my code to GitHub and invite collaborators. And when I want to run experiments and need more compute power, I rent CPU and GPU instances in the cloud, copy my code and dependencies over, and run […]

Andy Jassy giving the 2019 re:Invent keynote.

re:Cap part one – open source at re:Invent 2019

As the dust settles after another re:Invent closes, I wanted to put together a quick summary of all the open source-related announcements that happened in the run up to this year’s re:Invent and the week itself. If you are interested in open source in mobile web development, devops, containers, security, big data and data analytics, […]

Mask R-CNN Segmentation mAP

Distributed TensorFlow training using Kubeflow on Amazon EKS

Training heavy-weight deep neural networks (DNNs) on large datasets ranging from tens to hundreds of GBs often takes an unacceptably long time. Business imperatives force us to search for solutions that can reduce the training time from days to hours. Distributed data-parallel training of DNNs using multiple GPUs on multiple machines is often the right […]

GluonTS-graph.

Announcing Gluon Time Series, an Open-Source Time Series Modeling Toolkit

Today, we announce the availability of Gluon Time Series (GluonTS), an Apache MXNet-based toolkit for time series analysis using the Gluon API. We are excited to give researchers and practitioners working with time series data access to this toolkit, which we have built for our own needs as applied scientists working on real-world industrial time […]

EKS performance - resnet50.

Best Practices for Optimizing Distributed Deep Learning Performance on Amazon EKS

中文版 – In this post, we will demonstrate how to create a fully-managed Kubernetes cluster on AWS using Amazon Elastic Container Service for Kubernetes (Amazon EKS), and how to run distributed deep learning training jobs using Kubeflow and the AWS FSx CSI driver. We then will discuss best practices to optimize machine learning training performance […]

The Seattle Spheres - photo by Deirdré Straughan.

Open Source News Roundup: April 22, 2019

Upcoming Events RailsConf (April 30-May 2 in Minneapolis, Minnesota) – Lounge & Lanyard Sponsor. Workshop on Going Serverless with Ruby on AWS Lambda by Alex Wood and Jingyi Chen. PyCon (May 1-9 in Cleveland, Ohio) – Platinum Sponsor. Come find us at Booth #439 to see how AWS <3 Python. Percona Live (May 28-30 in […]

AWS SF loft sign "Code Happy"

Open Source News Roundup: June 22, 2018

Next Week! Amazon Linux Launch Event Join us for an interactive event and discover how you can innovate faster using AWS services for Amazon Linux. Senior product leaders from Amazon will announce new features, provide interactive demos, and AWS Chief Evangelist Jeff Barr will share his insights. Afterwards, join us for drinks to celebrate and […]

SAM - What's next? You!

Open Source News Roundup: April 13, 2018

Open Source News from the AWS Summit San Francisco The AWS Summit in San Francisco on April 4th saw a slew of announcements, including some in open source: SAM Implementation is now open source! “In 2016, we launched SAM and opened up the SAM specification on this Github repo to invite collaborators. We’ve loved your […]

editing open source AWS documentation

Open Source News Roundup: March 30, 2018

September 8, 2021: Amazon Elasticsearch Service has been renamed to Amazon OpenSearch Service. Visit the website to learn more. AWS Documentation is Now Open Source and On GitHub Earlier this year we made the AWS SDK developer guides available as GitHub repos (all found within the awsdocs organization) and invited interested parties to contribute changes […]