Containers

Chiedu Eluehike

Author: Chiedu Eluehike

Chiedu is an Enterprise Solutions Architect at Amazon Web Services currently based out of Sydney, Australia. In his role, he helps customers achieve their business objectives and uncover opportunities for value using Cloud Solutions. He is CCIE#48238. Outside of work, he enjoys watching and playing soccer, listening to podcasts, trying new food in restaurants, mindfulness meditation, and has taken an interest in poker.

Enhancing and monitoring network performance when running ML Inference on Amazon EKS

In this post, we explore how to enhance and monitor network performance for ML inference workloads running on Amazon EKS using the newly launched Container Network Observability feature. We demonstrate practical use cases through a sample Stable Diffusion image generation workload, showing how platform teams can visualize service communication, analyze traffic patterns, investigate latency issues, and identify network bottlenecks—ultimately improving metrics like inference latency and time to first token.

Read our blog post on securing Amazon Elastic Container Service applications using Application Load Balancer and Amazon Cognito.

Securing Amazon Elastic Container Service applications using Application Load Balancer and Amazon Cognito

Introduction Designing and maintaining secure user management, authentication and other related features for applications is not an easy task. Amazon Cognito takes care of this work, which allows developers to focus on building the core business logic of the application. Amazon Cognito provides user management, authentication, and authorization for applications where users can log in […]