Containers
Category: Messaging
Scalable and Cost-Effective Event-Driven Workloads with KEDA and Karpenter on Amazon EKS
In today’s cloud-native landscape, efficient management of event-driven workloads is essential for real-time data processing. Traditional autoscaling often falls short amidst unpredictable event volumes, leading to inefficiencies and increased costs. Amazon Elastic Kubernetes Service (EKS), which is a managed container orchestration platform and is well-suited for deploying container-based applications. By integrating Kubernetes Event-Driven Autoscaling (KEDA) […]
Implementing a pub/sub architecture with AWS Copilot
Introduction The AWS Copilot CLI is a tool that since its launch in 2020, developers have been using to build, manage, and operate Linux and Windows containers on Amazon Elastic Container Service (Amazon ECS), AWS Fargate, and AWS App Runner. In this post, I’ll walk you through how you can use AWS Copilot CLI to […]
Dynamic Spark Scaling on Amazon EKS with Argo Workflows and Events
Introduction Kubernetes has gained widespread adoption in the field of data processing because of its ability to package and deploy applications as containers with all required dependencies, as well as its support for running data frameworks. This makes it easy for developers to run their Data Analytics/Machine Learning (ML) applications within a Kubernetes cluster and […]
Stretching your on-premises environment to AWS using Amazon ECS Anywhere
Amazon Elastic Container Service (Amazon ECS) allows customers to run container workloads in AWS on AWS-managed infrastructure as well as on customer-managed infrastructure using Amazon ECS Anywhere. Whether on premises or in the cloud, customers have a consistent cluster management, workload scheduling, and monitoring experience with Amazon ECS. Amazon ECS Anywhere lets you have a […]
Amazon Elastic Container Service (ECS) Auto Scaling using custom metrics
Introduction Amazon ECS eliminates the need to install, operate, and scale your own cluster management infrastructure. Customers are using horizontal scalability to deploy and scale their microservices applications running on Amazon ECS. They use the Application Auto Scaling service to automatically scale based on metrics data. Amazon ECS typically measures service utilization based on average […]
Implementing the Saga Orchestration pattern with Amazon EKS and Amazon SNS
This blog post proposes an ecommerce scenario with an Orders microservice, an Orders Rollback microservice and an Inventory microservice that communicate with each other. This communication happens while raising an order successfully or rolling back an order when the Inventory microservice reports an error. This communication is orchestrated with Amazon Simple Notification Service (Amazon SNS) […]