AWS HPC Blog

Category: AWS Batch

Leveraging Seqera Platform on AWS Batch for machine learning workflows - Part 1 of 2

Leveraging Seqera Platform on AWS Batch for machine learning workflows – Part 1 of 2

Nextflow is popular workflow framework for genomics pipelines, but did you know you can also use it for machine-learning? ML is already being used for medical imaging, protein folding, drug discovery, and gene editing. In this post, we explain how to build an example Nextflow pipeline that performs ML model-training and inference for image analysis.

How Amazon’s Search M5 team optimizes compute resources and cost with fair-share scheduling on AWS Batch

How Amazon’s Search M5 team optimizes compute resources and cost with fair-share scheduling on AWS Batch

In this post, we share how Amazon Search optimizes their use of accelerated compute resources using AWS Batch fair-share scheduling to schedule distributed deep learning workloads.