AWS Open Source Blog
Category: Artificial Intelligence
Delta Sharing on AWS
This post was written by Frank Munz, Staff Developer Advocate at Databricks. An introduction to Delta Sharing During the past decade, much thought went into system and application architectures using domain-driven design and microservices, but we are still on the verge of building distributed data meshes. Such data meshes are based on two fundamental principles: […]
Implementing a hub and spoke dashboard for multi-account data science projects
Modern data science environments often involve many independent projects, each spanning multiple accounts. In order to maintain a global overview of the activities within the projects, a mechanism to collect data from the different accounts into a central one is crucial. In this post, we show how to leverage existing services—Amazon DynamoDB, AWS Lambda, Amazon […]
Getting started with Feast, an open source feature store running on AWS Managed Services
This post was written by Willem Pienaar, Principal Engineer at Tecton and creator of Feast. Feast is an open source feature store and a fast, convenient way to serve machine learning (ML) features for training and online inference. Feast lets you build point-in-time correct training datasets from feature data, allows you to deploy a production-grade […]
Solving the Traveling Salesperson Problem with deep reinforcement learning on Amazon SageMaker
The Traveling Salesperson Problem (TSP) is one of the most popular NP-hard combinatorial problems in the theoretical computer science and operations research (OR) community. It asks the following question: “Given a list of cities and the distances between each pair of cities, what is the shortest possible route that visits each city exactly once and […]
How to use InfluxDB and Grafana to visualize ML output with AWS IoT Greengrass
Machine learning (ML) algorithms are widely used for computer vision (CV) applications, such as image classification, object detection, and semantic segmentation. With the latest development of the Industrial Internet of Things (IIoT), ML algorithms can be directly implemented at the edge device to process image data and perform anomaly detection, such as for product quality […]
Enhancing data science environments with Vim, tmux, and Zsh on Amazon EC2
This post was written by Josiah Davis, Yin Song, and Anne Hu. The solution can also be found on GitHub. Many professional data scientists are adopting open source software development tools such as Vim, tmux, and Zsh to get more productivity out of their working environment. Vim is a free and open source, highly configurable […]
AWS DeepRacer is now open source and ready to hit the road with ROS 2
Reinforcement learning (RL) has become one of the most popular machine learning techniques for training robots in simulation. RL enables models to learn complex behaviors without labeled training data and allows the models to make short-term decisions while optimizing for longer-term goals. AWS DeepRacer offers an autonomous 1/18th scale race car driven by a reinforcement […]
Using Streamlit to build an interactive dashboard for data analysis on AWS
In this article, we’ll show how to stand up an Exploratory Data Analysis (EDA) dashboard for business users using Amazon Web Services (AWS) with Streamlit. Streamlit is an open source framework for data scientists to efficiently create interactive web-based data applications in pure Python. In this tutorial, the EDA dashboard allows for quick end-to-end deployment […]
Build, train, and deploy Amazon Lookout for Vision models using the Python SDK
Amazon Lookout for Vision is a new machine learning (ML) service that spots defects and anomalies in visual representations using computer vision (CV). It was made available in Preview at AWS re:Invent 2020 and became generally available in February 2021. This service lets manufacturing companies increase quality and reduce operational costs by quickly identifying differences […]
Embracing natural language processing with Hugging Face
In a previous post, I talked about how open source projects often work backwards from a specific problem or challenge, as one of their key motivators. In this post, I’ll explore another area where open source projects emerge: the need to follow an area of interest, a genuine passion, or an itch that needs to […]