AWS Open Source Blog

Category: Management Tools

RocknRoller Studios – stock.adobe.com Data storage Technology Concept with cloud symbol against a Futuristic, Blue Digital Grid background. Network Tech Wallpaper. 3D Render

Enabling Amazon Simple Storage Service (Amazon S3) Access Points in Apache Hadoop S3A

We’re pleased to announce that Amazon Simple Storage Service (Amazon S3) Access Points can now be used in Apache Hadoop 3.3.2 and any framework consuming the S3A connector or relying on the Hadoop Distributed File System (such as Apache Spark, Apache Hive, Apache Pig, and Apache Flink). In this post, we review what access point […]

Simplifying Amazon ECS monitoring set up with AWS Distro for OpenTelemetry

In this blog post, we explain how to set up AWS Distro for OpenTelemetry for Amazon Elastic Container Service (Amazon ECS) with the 1-click console integration. OpenTelemetry metrics and traces collection on Amazon ECS mainly consists in instrumenting your application and running the AWS Distro for OpenTelemetry Collector container, using its Amazon Elastic Container Registry […]

AWS Distro for OpenTelemetry 0.14 is now available with updated Lambda layers

AWS Distro for OpenTelemetry 0.14 is now available. You can download the latest AWS Distro for OpenTelemetry Collector image from the  Amazon Elastic Container Registry (Amazon ECR) Public Gallery. Release highlights OpenTelemetry Collector v0.38.0 Updated Lambda layers for Java, Java auto-instrumentation agent, JavaScript, and .Net New OpenTelemetry Operator image added to public Amazon ECR Added […]

Auto-instrumenting a Python application with an AWS Distro for OpenTelemetry Lambda layer

Customers want better insight into understanding the behavior of their systems, but not all customers can afford to make significant code changes in their existing pipelines to add more observability. In this walkthrough, we explain how to get telemetry data from AWS Lambda Python functions, without having to change a line of code. Find the […]

Scaling Cortex with parallel compaction

In this post, Albert Choi, an intern on the Amazon Managed Service for Prometheus team, shares his experience of designing and implementing parallel compactors inside of the Cortex open source project. The addition to the compactors enables Cortex to handle large volumes of active metrics per tenant. This blog post details the work done as […]

Tierney – stock.adobe.com

Performing canary deployments and metrics-driven rollback with Amazon Managed Service for Prometheus and Flagger

This post was written by Kevin Bell and Stefan Prodan. Canary deployments are a popular tool to reduce risk when deploying software, by exposing a new version to a small subset of traffic before rolling it out more broadly. Creating the machinery to do this kind of controlled rollout, and monitoring for possible problems and […]

Setting up Amazon Managed Grafana cross-account data source using customer managed IAM roles

Amazon Managed Grafana is a fully managed and secure data visualization service for open source Grafana that enables customers to instantly query, correlate, and visualize operational metrics, logs, and traces for their applications from multiple data sources. Amazon Managed Grafana integrates with multiple Amazon Web Services (AWS) security services, and supports AWS Single Sign-On (AWS […]

AWS Distro for OpenTelemetry is now GA for tracing

AWS Distro for OpenTelemetry (ADOT) is now generally available with production-ready tracing support. You can download the latest ADOT Collector image from the Amazon Elastic Container Registry (Amazon ECR) Public Gallery. Highlights End-to-end support for collecting, processing, and exporting traces. OTLP v 0.9.0 fully supported. Stability guarantees for tracing in the OpenTelemetry Protocol (OTLP). Semantic […]

Simplifying OpenTelemetry Collector and Go library releases with the Go MultiMod tool

Managing versions and releases of multiple Go Modules can be a struggle to perform manually for maintainers of large repositories, especially due to the lack of official Golang support for this task. In this post, AWS Observability intern software engineer Eddy Lin discusses his experience building the Go MultiMod tool, an open source solution that […]

Illustration of overall deletion process

Building a series deletion API in Cortex

In this post, Ilan Gofman, an intern on the Amazon Managed Service for Prometheus team, shares his experience of designing and implementing the series deletion feature inside of the Cortex open source project. This new API will provide the ability to delete series from Cortex using the blocks storage engine. This blog post details the […]