AWS Open Source Blog

Category: Customer Solutions

Creating a bridge between machine learning and quantum computing with PennyLane

In this post, Josh Izaac (Xanadu) and Eric Kessler (AWS) explain how the open source PennyLane project helps bridge the gap between the quantum computing and machine learning communities. Today, we are announcing that AWS is joining the steering council of the PennyLane open source project for variational quantum computing and quantum machine learning. Our […]

Set up cross-region metrics collection for Amazon Managed Service for Prometheus workspaces

Amazon Managed Service for Prometheus is a Prometheus-compatible monitoring service for container infrastructure and application metrics that makes it easy for customers to securely monitor container environments at scale. In a previous getting started blog post, we showed how to set up an Amazon Managed Service for Prometheus workspace and ingest metrics from an Amazon […]

3dddcharacter – stock.adobe.com

Setting up Grafana on EC2 to query metrics from Amazon Managed Service for Prometheus

The recently launched Amazon Managed Service for Prometheus (AMP) service provides a highly available and secure environment to ingest, query, and store Prometheus metrics. We can query the metrics from the AMP environment using Amazon Managed Grafana, a self-hosted Grafana server, or using the HTTP APIs. In this article, we will look at how to […]

olegkruglyak3 – stock.adobe.com

How Netflix uses Deep Java Library (DJL) for distributed deep learning inference in real-time

This post was written by Stanislav Kirdey, Lan Qing, Lai Wei, and Lu Huang. Netflix is one of the world’s largest entertainment services with over 260 million members in more than 190 countries. One of the ways Netflix is able to sustain a high-quality customer experience is by employing deep learning models in the observability […]

3dddcharacter – stock.adobe.com

The CDK Patterns open source journey

This post was contributed by Matthew Coulter, Technical Architect at Liberty Mutual. In the summer of 2019, I successfully applied for a promotion to the position of account architect at Liberty IT Solutions, a part of Liberty Mutual Group. This changed everything, as I went from being the systems architect supporting one area to an […]

radachynskyi – stock.adobe.com - stacks of blocks

Improving zlib-cloudflare and comparing performance with other zlib forks

We worked with the maintainers of the Cloudflare fork of zlib (zlib-cloudflare) to improve the decompression performance on Arm and x86. With the changes, at level 6: On Arm: Compression performance: ~90 percent faster than zlib-madler (original zlib). Decompression performance: ~52 percent faster than zlib-madler. On x86: Compression performance: ~113 percent faster than zlib-madler. Decompression […]

Tierney – stock.adobe.com

Integrating EC2 macOS workers with EKS and Jenkins

Kicking off re:Invent 2020, VP of EC2 at AWS, Dave Brown, introduced an all new Amazon EC2 Mac instance. This new Amazon Elastic Compute Cloud (Amazon EC2) instance allows developers to build, test, package, and sign Xcode applications for the Apple platforms including macOS, iOS, iPadOS, tvOS, watchOS, and Safari. One common question I hear from […]

How Falco uses Prow on AWS for open source testing

This post was co-written with Leo Di Donato, an open source software engineer at Sysdig in the Office of the CTO. Kubernetes has seen massive growth in the past few years. However, with all growth comes growing pains, and CI/CD has brought a few interesting problems to the space, especially for the open source community. […]

Deploy fast.ai-trained PyTorch model in TorchServe and host in Amazon SageMaker inference endpoint

Over the past few years, fast.ai has become one of the most cutting-edge, open source, deep learning frameworks and the go-to choice for many machine learning use cases based on PyTorch. It has not only democratized deep learning and made it approachable to general audiences, but fast.ai has also become a role model on how […]

AWS Distro for OpenTelemetry adds Prometheus and Lambda support and other cool features

Today’s release of the AWS Distro for OpenTelemetry (ADOT) now brings support for Prometheus and AWS Lambda and adds AWS X-Ray support in Go and Python. The release also adds an OpenTelemetry Protocol (OTLP) HTTP exporter, an AWS EMF exporter, and an X-Ray exporter. Prometheus support: Prometheus support includes an out-of-process remote write exporter for […]