AWS Public Sector Blog
Maximizing EC2 Spot Instance reliability for Nextflow on AWS Batch with Memory Machine Batch
AWS partners with providers of innovative solutions such as MemVerge, an AWS Partner Network (APN) Advanced Technology Partner, whose Memory Machine Batch (MMBatch) technology complements AWS Batch by providing advanced checkpointing capabilities for EC2 Spot Instances. In this post, we look at how MemVerge’s technology can overcome the challenges of interrupted pipelines by enabling pipelines that were interrupted mid task to start from where they left off, regardless of Spot Instance reclaims. We’ll also show how MemVerge’s Batch Viewer and proven best practices empower researchers to visualize their workloads, identify bottlenecks, and apply smart strategies that make their pipelines more efficient, resilient, and cloud-optimized.
