AWS Open Source Blog

Category: Technical How-to

VAKSMANV – stock.adobe.com

Using strong typing practices to declare a large number of resources with AWS CDK

AWS Cloud Development Kit (AWS CDK) is an open source software development framework that is used to declare Infrastructure as Code (IaC). It allows users to declare infrastructure in a general-purpose programming language and is an abstraction built on top of AWS CloudFormation. Resources declared in AWS CDK compile down to CloudFormation stacks that can […]

Read More

Metrics collection from Amazon ECS using Amazon Managed Service for Prometheus

Prometheus is an open source monitoring solution that has emerged as a very popular tool for collecting metrics from microservices running in a variety of environments including Kubernetes. In tandem with Grafana, a widely deployed data visualization tool, Prometheus enables customers to query and visualize operational metrics collected from their workloads. Customers deploying their Prometheus […]

Read More
Diagram illustrating the setup outlined throughout the post.

Setting up cross-account ingestion into Amazon Managed Service for Prometheus

April 21, 2021: This article has been updated to reflect changes introduced by Sigv4 support on Prometheus server. The recently launched Amazon Managed Service for Prometheus (AMP) service provides a highly available and secure environment to ingest, query, and store Prometheus metrics. We can query the metrics from the AMP environment using Amazon Managed Service […]

Read More
Chepko Danil – stock.adobe.com

Move your Apache Airflow connections and variables to AWS Secrets Manager

Data scientists and engineers have made Apache Airflow a leading open source tool to create data pipelines due to its active open source community, familiar Python development as directed acyclic graph (DAG) workflows, and extensive library of prebuilt integrations. However, managing the connections and variables that these pipelines depend on can be a challenge, especially […]

Read More
Tierney – stock.adobe.com

Deploying a highly available Microsoft SQL Server on Linux on AWS

In this post, we walk through how to successfully design and build a highly available Microsoft SQL Server on Linux on Amazon Web Services (AWS). This post provides high-level insight into the components necessary to create this solution, including Microsoft SQL on Linux, ClusterLabs Pacemaker (Pacemaker) open source clustering software, leading Linux distributions, and AWS. […]

Read More
lazyllama – stock.adobe.com

Getting started with open source graph notebook for graph visualization

When building connected data applications, such as knowledge graphs, identity graphs, or fraud graphs, developers often need to visualize how the data is connected to be able to communicate insights gained from highly connected datasets. Customers need an easy way to get started with their graph database, insert data, and view the results. We launched […]

Read More
kras99 – stock.adobe.com

Open source mobile core network implementation on Amazon Elastic Kubernetes Service

As introduced in Amazon Web Services (AWS) whitepapers, Carrier-grade Mobile Packet Core Network on AWS and 5G Network Evolution with AWS, implementing 4G Evolved Packet Core (EPC) and 5G Core (5GC) on AWS can bring a significant value and benefit, such as scalability, flexibility, and programmable orchestration, as well as automation of the underlying infrastructure layer. This […]

Read More

Integrating identity providers, such as OneLogin, Ping Identity, Okta, and Azure AD, to SSO into Amazon Managed Service for Grafana

In December 2020, AWS announced Amazon Managed Service for Grafana (AMG), a fully managed service that is developed together with Grafana Labs and based on open source Grafana. Enhanced with enterprise capabilities, AMG makes it easier to visualize and analyze operational data at scale. In the blog post Amazon Managed Service for Grafana – Getting […]

Read More

Building a prototype for the Logging API and SDK for the OpenTelemetry C++ library

In this article, intern engineers on the open source observability team, Karen Xu and Mark Seufert, describe their design and implementation of an open source prototype Logging API and SDK for the OpenTelemetry C++ library. This library allows users to write and collect logs from their distributed and instrumented applications. This article details the goals […]

Read More
Credit: pressmaster – stock.adobe.com

Integrating EC2 macOS workers with EKS and GitLab

At our annual re:Invent conference in December 2020 we announced an all new macOS-based Amazon Elastic Compute Cloud (Amazon EC2) instance. This new instance allows developers to build, test, and package their applications for all Apple platforms, such as macOS, iOS, iPadOS, tvOS, and watchOS. Customers have been asking us for ways to integrate their […]

Read More