AWS Open Source Blog

Category: Technical How-to

Automating a DAG deployment with Amazon Managed Workflows for Apache Airflow

Many developers and data engineers use Managed Workflows for Apache Airflow (Amazon MWAA), a managed service for open source Apache Airflow, to programmatically author, schedule, and monitor workflows. With Amazon MWAA, you can focus on business logic and build workflows without worrying about the management responsibilities such as setup, patching, upgrades, security, scaling, and so […]

Read More
kras99 - stock.adobe.com internet digital security technology concept for business background. Lock on circuit board

Security features of Bottlerocket, an open source Linux-based operating system

Bottlerocket is an open source Linux-based operating system from Amazon that was purpose built for running containers with a strong emphasis on security. The result is an operating system that comes with a variety of built-in controls for creating a secure environment for running containerized workloads. In this post, we’ll explore several of the security […]

Read More

Adding StatefulSet support in the OpenTelemetry Operator

In this post, AWS interns, software engineers Huy Vo and Iris Song, share their experience with adding StatefulSet support in the OpenTelemetry Operator and their design approach to building a scrape target update service into the OpenTelemetry Collector’s Prometheus receiver. OpenTelemetry (OTEL) is a popular open source framework used for observability. It provides a set […]

Read More

Solving the Traveling Salesperson Problem with deep reinforcement learning on Amazon SageMaker

The Traveling Salesperson Problem (TSP) is one of the most popular NP-hard combinatorial problems in the theoretical computer science and operations research (OR) community. It asks the following question: “Given a list of cities and the distances between each pair of cities, what is the shortest possible route that visits each city exactly once and […]

Read More
Illustration of overall deletion process

Building a series deletion API in Cortex

In this post, Ilan Gofman, an intern on the Amazon Managed Service for Prometheus team, shares his experience of designing and implementing the series deletion feature inside of the Cortex open source project. This new API will provide the ability to delete series from Cortex using the blocks storage engine. This blog post details the […]

Read More
your123 - stock.adobe.com - Connecting people on the internet, nodes transforming. Social network connections. Information technology of internet of things IOT big data clouds computing using artificial intelligence

How to use InfluxDB and Grafana to visualize ML output with AWS IoT Greengrass

Machine learning (ML) algorithms are widely used for computer vision (CV) applications, such as image classification, object detection, and semantic segmentation. With the latest development of the Industrial Internet of Things (IIoT), ML algorithms can be directly implemented at the edge device to process image data and perform anomaly detection, such as for product quality […]

Read More

Adding AWS X-Ray support to the OpenTelemetry PHP library

In this blog post, AWS observability team intern engineer Oliver Hamuy shares his internship experience on his project to enhance the OpenTelemetry PHP SDK by adding support for AWS X-Ray. Please note that the OpenTelemetry PHP SDK is in development and in alpha state currently. We’ve tested the X-Ray pipeline for simple tracing using a […]

Read More

Implementing CloudWatch-centric observability for Kubernetes-native developers in Amazon Elastic Kubernetes Service

This post was written by Seth Dobson (Southwest Airlines), Paul Ramsey, and Sheetal Joshi. The solution presented in this blog shows how large enterprise organizations such as Southwest Airlines can implement an end-to-end, Amazon CloudWatch-centric observability solution for Kubernetes clusters running on Amazon Elastic Kubernetes Service (Amazon EKS) in a way that feels natural for […]

Read More

Building a Helm chart for deploying the OpenTelemetry Operator

In this post, Shibo Wang, an intern on the AWS Open Source Observability team, shares his experience of designing and building the OpenTelemetry Operator Helm chart and integrating the OpenTelemetry Operator into the AWS Distro for OpenTelemetry (ADOT). This open source Helm chart allows you to install the OpenTelemetry Operator to an on-premises or managed […]

Read More
3dddcharacter – stock.adobe.com

Deployment patterns for the AWS Distro for OpenTelemetry Collector with Amazon Elastic Container Service

The AWS Distro for OpenTelemetry (ADOT) is a secure, production-ready, AWS-supported distribution of the OpenTelemetry project. Cloud-native, distributed technology stacks are now the norm, but these architectures introduce operational challenges, which have led to the rise of observability. Several different patterns can be used for deploying ADOT for observability, and this blog post will describe […]

Read More