Containers
Author: Robert Belson
Robert is a Senior Solutions Architect at AWS specializing in applied AI and hybrid cloud infrastructure. He works with enterprise customers to architect production AI workloads across hybrid and edge environments, from agentic systems to GPU-accelerated inference on Local Zones and Outposts. Robert is a regular host on AWS On Air, reaching millions of developers each year.
Extending GPU Fractionalization and Orchestration to the edge with NVIDIA Run:ai and Amazon EKS
In this post, we explore how AWS and NVIDIA Run:ai are extending GPU fractionalization and orchestration capabilities beyond traditional cloud regions to edge environments, including AWS Local Zones, Outposts, and EKS Hybrid Nodes. The collaboration addresses the growing demand for distributed AI/ML workloads that require efficient GPU resource management across geographically separated locations while maintaining consistent performance, compliance, and cost optimization .
Managing edge-aware Service Mesh with Amazon EKS for AWS Local Zones
Introduction In a previous post, Deploy geo-distributed Amazon EKS cluster on AWS Wavelength, we introduced how to extend Amazon Elastic Kubernetes Service (Amazon EKS) clusters closer to end-users for 5G network-connected applications. However, this exact pattern of using self-managed node groups also applies to AWS Local Zones, an infrastructure solution that brings AWS compute and […]
Deploy geo-distributed Amazon EKS clusters on AWS Wavelength
Introduction In December 2019, we announced AWS Wavelength, new AWS infrastructure that allows customers to deploy workload closer to 5G-connected users and devices. Customers can now use AWS Wavelength to deploy Amazon Elastic Compute Cloud (Amazon EC2) instances, Amazon Elastic Kubernetes Service (Amazon EKS) clusters and a suite of supported partner solutions available on the […]