AWS Open Source Blog
Category: Artificial Intelligence
Machine learning with AutoGluon, an open source AutoML library
If you work in data science, you might think that the hardest thing about machine learning is not knowing when you’ll be done. You start with a problem, a dataset, and an idea about how to solve it, but you never know whether your approach is going to work until later, after you’ve wasted time. […]
Why use Docker containers for machine learning development?
I like prototyping on my laptop, as much as the next person. When I want to collaborate, I push my code to GitHub and invite collaborators. And when I want to run experiments and need more compute power, I rent CPU and GPU instances in the cloud, copy my code and dependencies over, and run […]
re:Cap part one – open source at re:Invent 2019
As the dust settles after another re:Invent closes, I wanted to put together a quick summary of all the open source-related announcements that happened in the run up to this year’s re:Invent and the week itself. If you are interested in open source in mobile web development, devops, containers, security, big data and data analytics, […]
Distributed TensorFlow training using Kubeflow on Amazon EKS
Training heavy-weight deep neural networks (DNNs) on large datasets ranging from tens to hundreds of GBs often takes an unacceptably long time. Business imperatives force us to search for solutions that can reduce the training time from days to hours. Distributed data-parallel training of DNNs using multiple GPUs on multiple machines is often the right […]
Announcing Gluon Time Series, an Open-Source Time Series Modeling Toolkit
Today, we announce the availability of Gluon Time Series (GluonTS), an Apache MXNet-based toolkit for time series analysis using the Gluon API. We are excited to give researchers and practitioners working with time series data access to this toolkit, which we have built for our own needs as applied scientists working on real-world industrial time […]
Best Practices for Optimizing Distributed Deep Learning Performance on Amazon EKS
中文版 – In this post, we will demonstrate how to create a fully-managed Kubernetes cluster on AWS using Amazon Elastic Container Service for Kubernetes (Amazon EKS), and how to run distributed deep learning training jobs using Kubeflow and the AWS FSx CSI driver. We then will discuss best practices to optimize machine learning training performance […]
Open Source News Roundup: April 22, 2019
Upcoming Events RailsConf (April 30-May 2 in Minneapolis, Minnesota) – Lounge & Lanyard Sponsor. Workshop on Going Serverless with Ruby on AWS Lambda by Alex Wood and Jingyi Chen. PyCon (May 1-9 in Cleveland, Ohio) – Platinum Sponsor. Come find us at Booth #439 to see how AWS <3 Python. Percona Live (May 28-30 in […]
Open Source News Roundup: June 22, 2018
Next Week! Amazon Linux Launch Event Join us for an interactive event and discover how you can innovate faster using AWS services for Amazon Linux. Senior product leaders from Amazon will announce new features, provide interactive demos, and AWS Chief Evangelist Jeff Barr will share his insights. Afterwards, join us for drinks to celebrate and […]
Open Source News Roundup: April 13, 2018
Open Source News from the AWS Summit San Francisco The AWS Summit in San Francisco on April 4th saw a slew of announcements, including some in open source: SAM Implementation is now open source! “In 2016, we launched SAM and opened up the SAM specification on this Github repo to invite collaborators. We’ve loved your […]
Open Source News Roundup: March 30, 2018
September 8, 2021: Amazon Elasticsearch Service has been renamed to Amazon OpenSearch Service. Visit the website to learn more. AWS Documentation is Now Open Source and On GitHub Earlier this year we made the AWS SDK developer guides available as GitHub repos (all found within the awsdocs organization) and invited interested parties to contribute changes […]