Containers

How Salesforce efficiently right-sizes Kubernetes workloads at scale on Amazon EKS

How Salesforce efficiently right-sizes Kubernetes workloads at scale on Amazon EKS

Salesforce operates one of the largest multi-tenant Kubernetes platforms on Amazon EKS, spanning 1,400+ clusters. See how its team combined the Vertical Pod Autoscaler and Horizontal Pod Autoscaler into a multi-dimensional autoscaling strategy that right-sizes workloads at scale and drove more than $5 million in infrastructure savings.

Automatically recover from GPU failures with Amazon ECS Managed Instances

Automatically recover from GPU failures with Amazon ECS Managed Instances

Amazon ECS Managed Instances provides built-in GPU health monitoring and automatic repair powered by NVIDIA DCGM. This post shows how GPU auto-repair detects critical GPU hardware failures and replaces impaired instances with no code changes, and how to observe and safely validate the workflow using DCGM fault injection on a dual-tier inference pipeline.

AWS Nitro Sandboxes: Hardware-enforced workload isolation on Amazon EKS

AWS Nitro Sandboxes: Hardware-enforced workload isolation on Amazon EKS

AWS Nitro Sandboxes bring hardware-enforced, per-pod isolation to Amazon EKS. Every sandboxed pod runs in its own lightweight virtual machine with the isolation of a dedicated Amazon EC2 instance and the simplicity of a Kubernetes pod. Learn how it works and how to turn it on with a one-line change to your pod spec.

Measuring developer experience on an Amazon EKS developer platform

Measuring developer experience on an Amazon EKS developer platform

Most platform teams can’t prove their internal developer platform is improving software delivery. This post shows how to automatically collect the four DORA metrics (deployment frequency, lead time for changes, change failure rate, and failed deployment recovery time) on an Amazon EKS platform using Argo CD, Argo Rollouts, Apache DevLake, and Grafana.

Observability patterns for AI agents on Amazon EKS

Observability patterns for AI agents on Amazon EKS

Traditional monitoring shows an AI agent’s endpoint returned HTTP 200, but not why it picked the wrong tool, burned through your token budget, or looped. This post implements two OpenTelemetry observability patterns for AI agents on Amazon EKS, decentralized and centralized, using Bifrost, Amazon Bedrock, and Langfuse.

Automating secure container registry management for air-gapped AWS workloads

Automating secure container registry management for air-gapped AWS workloads

Organizations in regulated industries run container workloads in air-gapped AWS environments, which means migrating hundreds of Helm charts and images into private Amazon ECR with consistent security controls. This post uses Amazon ECR repository creation templates, Terraform, and a migration tool to make secure-by-default the path of least resistance.

Migrating from NGINX Ingress to ALB: Handling oauth2-proxy

Migrating from NGINX Ingress to ALB: Handling oauth2-proxy

The NGINX Ingress Controller is retired. If you run oauth2-proxy with NGINX for OpenID Connect authentication, switching to the AWS Load Balancer Controller can silently break your auth. This post shows two ways to keep OIDC working on an Application Load Balancer: run oauth2-proxy in reverse proxy mode, or use ALB native OIDC.