AWS Open Source Blog

Category: Compute

architecture for a Spinnaker pipeline with Jenkins and Amazon ECR.

Build a Deployment Pipeline with Spinnaker on Kubernetes

Spinnaker is a continuous delivery platform, originally developed by Netflix, for releasing software changes rapidly and reliably. Spinnaker makes it easier for developers to focus on writing code without having to worry about the underlying cloud infrastructure. It integrates seamlessly with Jenkins and other popular build tools. In this post we will discuss on how […]

Read More
AWS + Kubernetes logos.

Using Pod Security Policies with Amazon EKS Clusters

You asked for it and with Kubernetes 1.13 we have enabled it:  Amazon Elastic Container Service for Kubernetes (EKS) now supports Pod Security Policies. In this post we will review what PSPs are, how to enable them in the Kubernetes control plane and how to use them, from both the cluster admin and the developer perspective. What is a Pod Security Policy and […]

Read More
example of a Mach 3 external flow calculation.

Scale HPC Workloads with Elastic Fabric Adapter and AWS ParallelCluster

中文版 – In April, 2019, AWS announced the general availability of Elastic Fabric Adapter (EFA), an EC2 network device that improves throughput and scalability of distributed High Performance Computing (HPC) and Machine Learning (ML) workloads. Today, we’re excited to announce support of EFA through AWS ParallelCluster. EFA is a network interface for Amazon EC2 instances […]

Read More
Firecracker logo.

Firecracker Open Source Update May, 2019

中文版 – It’s been six months since we launched Firecracker at re:Invent, and we’ve been thrilled by the reception that the open source community has given us. Over these six months, we have merged 87 commits from 30+ external contributors into the Firecracker master branch (representing ~24% of all commits in that time span). These […]

Read More
EKS performance - resnet50.

Best Practices for Optimizing Distributed Deep Learning Performance on Amazon EKS

中文版 – In this post, we will demonstrate how to create a fully-managed Kubernetes cluster on AWS using Amazon Elastic Container Service for Kubernetes (Amazon EKS), and how to run distributed deep learning training jobs using Kubeflow and the AWS FSx CSI driver. We then will discuss best practices to optimize machine learning training performance […]

Read More
The Seattle Spheres - photo by Deirdré Straughan.

Open Source News Roundup: April 22, 2019

Upcoming Events RailsConf (April 30-May 2 in Minneapolis, Minnesota) – Lounge & Lanyard Sponsor. Workshop on Going Serverless with Ruby on AWS Lambda by Alex Wood and Jingyi Chen. PyCon (May 1-9 in Cleveland, Ohio) – Platinum Sponsor. Come find us at Booth #439 to see how AWS <3 Python. Percona Live (May 28-30 in […]

Read More

Using the FSx for Lustre CSI Driver with Amazon EKS

中文版 – The Container Storage Interface (CSI) is a standard for exposing storage on top of container orchestrators such as Mesos or Kubernetes. CSI gives storage providers like AWS the opportunity to create a thin wrapper which will allow a Kubernetes cluster to automatically provision and manage the entire lifecycle of the storage class. Storage […]

Read More
Kiali graph.

Observe Your Service Mesh with Kiali

中文版 – Observability in a service mesh gives you details about the topology of your microservices-based application. It tells what microservices are part of the service mesh, how are they connected, how much traffic is routed to them, and other details. This post from Heiko Rupp shows how Kiali can be used to visualize an […]

Read More
knative + TriggerMesh + EKS logos.

Deploying AWS Lambda-Compatible Functions in Amazon EKS using TriggerMesh KLR

中文版 – Custom AWS Lambda Runtimes were introduced at re:Invent 2018. Knative is an open source project to build, deploy, and manage serverless workloads. This post by Sebastien Goasguen explains that TriggerMesh’s Knative Lambda Runtime is a custom runtime that can run a Lambda function on Knative running on an Amazon EKS cluster. –Arun AWS […]

Read More