AWS Open Source Blog

Category: Technical How-to

Virtual GPU device plugin for inference workloads in Kubernetes

Machine learning (ML) has become a centerpiece for enterprise transformation. AWS provides a broad and deep set of ML capabilities for builders with all levels of expertise. Developers with no prior ML experience can seamlessly build sophisticated AI-driven applications using AWS AI services. Developers and data scientists can use Amazon SageMaker, a managed machine learning […]

Read More

Managing compute environments for researchers with Service Workbench on AWS

Through cloud automation, researchers should be able to quickly and securely stand up cloud-based research environments that allow them to shift away from worrying about the technology they are using, and instead focus on their research and collaborating with peers from any institution. Once researchers have secured funding for a project, they must choose from […]

Read More

Integrating the OpenTelemetry JavaScript SDK with AWS X-Ray

In this blog post, AWS intern Cong Zou shares his experience contributing to a large open source project—OpenTelemetry—for the first time. OpenTelemetry provides a single set of APIs, libraries, agents, and collector services to capture distributed traces and metrics from applications. Users can analyze these traces and metrics using Prometheus, Jaeger, and other observability tools. […]

Read More

Building a Prometheus remote write exporter for the OpenTelemetry Go SDK

In this post, two AWS interns—Eric Lee and Connor Lindsey—describe their experience building a Prometheus remote write exporter for the popular open source observability project OpenTelemetry.  As an engineer, understanding the performance and health of your applications and services is crucial. However, this can be challenging, especially when monitoring across various languages, infrastructures, and services. […]

Read More

Testing the OpenTelemetry C++ Prometheus Exporter

In this post AWS intern Eric Hsueh shares his experience working on OpenTelemetry. OpenTelemetry aims to be the industry standard in collecting telemetry data, which includes metrics, tracing, and logs. Together with fellow AWS intern Cunjun Wang, we developed a C++ Prometheus Exporter as a contribution to the C++ repository of the open source project […]

Read More

Using the K3s Kubernetes distribution in an Amazon EKS CI/CD pipeline

Modern microservices application stack, CI/CD pipeline, Kubernetes as orchestrator, hundreds or thousands of deployments per day—this all sounds good, until you realize that your Kubernetes development or staging environments are messed up by these deployments, and changes done by one developer team are affecting your developer team’s Kubernetes environment. In this post, we will walk […]

Read More

Deploying open source web conferencing solution BigBlueButton on AWS

Major advancements in technology have drastically changed how and where we conduct business. Pushed by the increased number of employees working remotely, the globalization of businesses, and the rise of instant, on-demand communications, technology has had to adapt. For modern and innovative businesses to grow and globalize, building and maintaining quality relationships with partners, suppliers, […]

Read More

Multi-environment CI/CD pipelines with AWS CodePipeline and open source tools

A common scenario AWS customers face is how to automate their infrastructure deployments on AWS. Customers must create a secure, agile workflow that deploys to the cloud and uses their preferred AWS services. Customers also need a reliable, supportable deployment pattern driven by automated workflows that are not overly complex and difficult to manage. Customer […]

Read More

Improving HA and long-term storage for Prometheus using Thanos on EKS with S3

Prometheus is an open source systems monitoring and alerting toolkit that is widely adopted as a standard monitoring tool with self-managed and provider-managed Kubernetes. Prometheus provides many useful features, such as dynamic service discovery, powerful queries, and seamless alert notification integration. Beyond certain scale, however, problems arise when basic Prometheus capabilities do not meet requirements […]

Read More

AWS adds a C++ Prometheus Exporter to OpenTelemetry

In this post, two AWS interns—Cunjun Wang and Eric Hsueh—describe their first engineering contributions to the popular open source observability project OpenTelemetry. OpenTelemetry aims to develop an open standard and provides implementation in multiple programming languages for collecting telemetry data, including metrics, tracing, and logs. The interns contributed the C++ Prometheus Exporter to the OpenTelemetry […]

Read More