Containers
Category: AWS Fargate
Under the hood: Lazy Loading Container Images with Seekable OCI and AWS Fargate
November 2023: AWS Fargate now supports having both SOCI and non SOCI enabled containers in the same Amazon ECS task, therefore the “All container images within an Amazon ECS Task need a SOCI Index Manifest” restriction no longer applies. To learn more see the whats new post. AWS Fargate, a serverless compute engine for […]
Scaling IaC and CI/CD pipelines with Terraform, GitHub Actions, and AWS Proton
Introduction Modern applications run on a variety of compute platforms in AWS including serverless services such as AWS Lambda, AWS App Runner, and AWS Fargate. Organizations today are often required to support architectures using a variety of these AWS services, each offering unique runtime characteristics, such as concurrency and scaling, which can be purpose fit […]
Hosting Amazon Managed Workflows for Apache Airflow (MWAA) Local-runner on Amazon ECS Fargate for development and testing
Introduction Data scientists and engineers have made Apache Airflow a leading open-source tool to create data pipelines due to its active open-source community, familiar Python development as Directed Acyclic Graph (DAG) workflows, and an extensive library of pre-built integrations. Amazon Managed Workflows for Apache Airflow (MWAA) is a managed service for Apache Airflow that makes […]
Migrate cron jobs to event-driven architectures using Amazon Elastic Container Service and Amazon EventBridge
Introduction Many customers use traditional cron job schedulers in on-premise systems. They need a simple approach to move these scheduled tasks to AWS without refactoring while unlocking the scalability of the cloud. A lift-and-shift migration to Amazon Elastic Compute Cloud (Amazon EC2) is always a possibility, but that doesn’t take advantage of cloud-native services or […]
How Sentra manages data workflows using Amazon EKS, Dagster, and Karpenter to maximize cost-efficiency with minimal operational overhead
By Yael Grossman Sr Compute Specialist Solutions Architect at AWS, Roei Jacobovich Software Engineer at Sentra Introduction In this post, we’ll illustrate how Sentra utilizes Amazon Elastic Kubernetes Service (Amazon EKS), AWS Fargate , EC2 Spot, Karpenter, and an open-source version of Dagster, a cloud-native orchestrator, to run efficient and scalable data processing workloads on […]
Implementing a pub/sub architecture with AWS Copilot
Introduction The AWS Copilot CLI is a tool that since its launch in 2020, developers have been using to build, manage, and operate Linux and Windows containers on Amazon Elastic Container Service (Amazon ECS), AWS Fargate, and AWS App Runner. In this post, I’ll walk you through how you can use AWS Copilot CLI to […]
Architecture evolution: From zero to future-proof architecture at home24
This blog was co-authored by Aurelijus Banelis, Senior Software Engineer at home24 Introduction Home24 is a leading pure-play home & living e-commerce platform in continental Europe and Brazil. It has third-party and private-label assortments combined with a tailored user experience — and that is a good foundation for a sustainable technology business. Aurelijus is proud […]
Introducing the Amazon EKS Workshop
Today we are delighted to announce the redesigned Amazon EKS Workshop, a Kubernetes-focused workshop created to familiarize you with Amazon Elastic Kubernetes Service (Amazon EKS) and related open-source technologies. The new workshop replaces the existing one, which is fully deprecated but continues to be accessible at archive.eksworkshop.com. The Amazon EKS Workshop is completely redesigned with […]
AWS App Runner now integrates with AWS Secrets Manager and AWS Systems Manager Parameter Store
AWS App Runner makes it easy to run web applications and APIs at production scale. It enables you to build, deploy, run, and observe web applications without the burden associated with infrastructure management. Many such applications externalize the storage of URLs, API keys, usernames, database secrets, and configuration parameters. Starting today, App Runner allows you to […]
Happy 5th birthday, AWS Fargate!
In just 5 years, AWS Fargate has emerged as the mission-critical infrastructure for customers seeking to adopt container-based applications without managing underlying infrastructure. Its ability to provide serverless compute paired with a unique security model, where every container is wrapped in a virtual machine, has earned the trust of many organizations. AWS Fargate has been […]