Category: Compute

Many customers prefer to use Docker images with AWS Batch and AWS Cloudformation for cost-effective and faster processing of complex jobs. To run batch workloads in the cloud, customers have to consider various orchestration needs, such as queueing workloads, submitting to a compute resource, prioritizing jobs, handling dependencies and retries, scaling compute, and tracking utilization […]

Edit: March 10th 2022 – Updated post to use AWS Cloud Development Kit (CDK) v2. Protecting systems from malware is an essential part of a systems protection strategy. It is important to both scan binaries and other files before introducing them into your system boundary and appropriately respond to potential threats in accordance to your […]

September 22, 2022: Migrated the reference application to AWS CDK v2. Renamed deployment.py to backend/component.py to support multi-component use cases and better emphasize the mapping of AWS Well-Architected Framework component terminology. Renamed pipeline.py to toolchain.py to expand the scope to any tools related to component’s software development life cycle (e.g. continuous deployment pipeline, pull request […]

Building an Apache Kafka data processing Java application using the AWS CDK Piotr Chotkowski, Cloud Application Development Consultant, AWS Professional Services Using a Java application to process data queued in Apache Kafka is a common use case across many industries. Event-driven and microservices architectures, for example, often rely on Apache Kafka for data streaming and […]

In this blog, we will leverage the development capabilities of the CDK for Kubernetes framework also known as cdk8s along with the AWS Cloud Development Kit (AWS CDK) framework to provision infrastructure through AWS CloudFormation. cdk8s allows us to define Kubernetes apps and components using familiar languages. cdk8s is an open-source software development framework for defining Kubernetes applications and […]

Starting with Neuron SDK v1.14.0, Neuron conda packages used to install Neuron SDK framework in Deep Learning AMI will no longer be supported. users should use pip upgrade command instead.

In a previous AWS Blog, I shared an application orchestration process to run Amazon Elastic Container Service (Amazon ECS) Tasks on AWS Fargate using AWS Step Functions. This blog will be similar continuation but here we will be running the same application on Amazon EKS as a Kubernetes job on Fargate using StepFunctions. Amazon EKS […]

AWS Fargate is a a serverless compute engine that supports several common container use cases, like running micro-services architecture applications, batch processing, machine learning applications, and migrating on premise applications to the cloud without having to manage servers or clusters of Amazon EC2 instances. AWS customers have a choice of fully managed container services, including […]

In a previous post, we showed how you can use the AWS Cloud Development Kit (AWS CDK) and AWS Chalice to develop both infrastructure and application logic as code. To help combine the two frameworks together, a cdk-chalice construct library was used that handled the low-level communication details. In collaboration with the original developer of […]

In order to achieve repeatable, secure, and automated deployments, it is necessary to set up a CI/CD pipeline. Typically, the CI/CD pipeline will lint configurations, build, test, and deploy your code and infrastructure using one seamless process. A common best practice for deploying your infrastructure and code to AWS is to tie into a source […]