AWS HPC Blog

Category: AWS Batch

Run simulations using multiple containers in a single AWS Batch job

Run simulations using multiple containers in a single AWS Batch job

Run simulations using multiple containers in a single AWS Batch job Matthew Hansen, Principal Solutions Architect, AWS Advanced Computing & Simulation Recently, AWS Batch launched a new feature that makes it possible to run multiple containers within a single job. This enables new scenarios customers have asked about like simulations for autonomous vehicles, multi-robot collaboration, […]

Leveraging Seqera Platform on AWS Batch for machine learning workflows - Part 1 of 2

Leveraging Seqera Platform on AWS Batch for machine learning workflows – Part 1 of 2

Nextflow is popular workflow framework for genomics pipelines, but did you know you can also use it for machine-learning? ML is already being used for medical imaging, protein folding, drug discovery, and gene editing. In this post, we explain how to build an example Nextflow pipeline that performs ML model-training and inference for image analysis.

How Amazon’s Search M5 team optimizes compute resources and cost with fair-share scheduling on AWS Batch

How Amazon’s Search M5 team optimizes compute resources and cost with fair-share scheduling on AWS Batch

In this post, we share how Amazon Search optimizes their use of accelerated compute resources using AWS Batch fair-share scheduling to schedule distributed deep learning workloads.