AWS Open Source Blog

Monitoring application health and performance with AWS Distro for OpenTelemetry

A key challenge for any developer operations team is to gain full observability of a service’s health. You may already use great monitoring products from providers such as Amazon, Google, Splunk, and others. However, most of these vendors define their own data specification for metrics, traces, and logs. It is difficult for customers to switch […]

Read More

AWS Distro for OpenTelemetry now available for public preview

Today’s distributed applications and systems are complex and constantly changing, making system observability challenging. For example, customers use multiple AWS SDKs and agents from different monitoring services to collect and analyze different performance data for their applications. Yesterday we announced the AWS Distro for OpenTelemetry, a 100% open source distribution of the OpenTelemetry project, which […]

Read More

Virtual GPU device plugin for inference workloads in Kubernetes

Machine learning (ML) has become a centerpiece for enterprise transformation. AWS provides a broad and deep set of ML capabilities for builders with all levels of expertise. Developers with no prior ML experience can seamlessly build sophisticated AI-driven applications using AWS AI services. Developers and data scientists can use Amazon SageMaker, a managed machine learning […]

Read More

Managing compute environments for researchers with Service Workbench on AWS

Through cloud automation, researchers should be able to quickly and securely stand up cloud-based research environments that allow them to shift away from worrying about the technology they are using, and instead focus on their research and collaborating with peers from any institution. Once researchers have secured funding for a project, they must choose from […]

Read More

Open sourcing the Porting Assistant for .NET

In July 2020, AWS launched the Porting Assistant for .NET, a tool for analyzing the compatibility of .NET Framework applications and estimating the effort required to port them to .NET Core. Porting applications to .NET Core enables you to take advantage of future investments in .NET, reduced license spend, and innovations to improve application scaling […]

Read More

Getting started with the open source data science tool Metaflow on AWS

Data science is hard. Customers face business challenges today at a scale larger and more complex than ever before, and data scientists bring unique skills to the table to help solve some of those problems. The concept is simple: Data scientists use large amounts of data to break a problem down into pieces that machines […]

Read More

Integrating the OpenTelemetry JavaScript SDK with AWS X-Ray

In this blog post, AWS intern Cong Zou shares his experience contributing to a large open source project—OpenTelemetry—for the first time. OpenTelemetry provides a single set of APIs, libraries, agents, and collector services to capture distributed traces and metrics from applications. Users can analyze these traces and metrics using Prometheus, Jaeger, and other observability tools. […]

Read More

Building a Prometheus remote write exporter for the OpenTelemetry Go SDK

In this post, two AWS interns—Eric Lee and Connor Lindsey—describe their experience building a Prometheus remote write exporter for the popular open source observability project OpenTelemetry.  As an engineer, understanding the performance and health of your applications and services is crucial. However, this can be challenging, especially when monitoring across various languages, infrastructures, and services. […]

Read More

Using multiple queues and instance types in AWS ParallelCluster 2.9

Since its release as an officially supported AWS tool and open source project in November 2018, AWS ParallelCluster has made it simple for high performance computing (HPC) customers to set up easy-to-use environments with compute, storage, job scheduling, and networking in the cloud in one cohesive package. These clusters can cater to a wide variety […]

Read More

Diagram Maker: Open sourcing IoT visualization

Today we are announcing Diagram Maker, an open source graphical user interface library for IoT application developers. With Diagram Maker, IoT application developers can define their own user interface and user experience, or suppress it completely and build their own custom behavior using Diagram Maker APIs. In this post, we explain how IoT application developers […]

Read More