AWS HPC Blog
Tag: Scientific Computing
Leveraging Seqera Platform on AWS Batch for machine learning workflows – Part 2 of 2
In this second part of using Nextflow for machine learning for life science workloads, we provide a step-by-step guide, explaining how you can easily deploy a Seqera environment on AWS to run ML and other pipelines.
Save up to 90% using EC2 Spot, even for long-running HPC jobs
New OS-level checkpointing tools can let you run existing HPC codes on EC2 Spot instances with minimal impact from interruptions. Read on for the details.
Slurm REST API in AWS ParallelCluster
Looking to integrate AWS ParallelCluster into an automated workflow? This post shows how to submit and monitor jobs programmatically with Slurm REST API (code examples included).
New: Research and Engineering Studio on AWS
Today we’re announcing Research and Engineering Studio on AWS, a self-service portal to help scientists and engineers access and manage virtual desktops to see their data and run their interactive applications in the cloud.
EFA: how fixing one thing, led to an improvement for … everyone
Today, we’re diving deep into the open-source frameworks that move MPI messages around, and showing you how work we did in the Open MPI and libfabrics community lead to an improvement for EFA users – and everyone else, too.
Introducing login nodes in AWS ParallelCluster
AWS ParallelCluster 3.7 now supports adding login nodes to your cluster, out of the box. Here, we’ll show you how to set this up, and highlight some important tunable options for tweaking the experience.
Implementing AWS ParallelCluster in a Shared VPC
In this post we’ll show you how to deploy ParallelCluster in a shared VPC environment so you can separate infrastructure management, cluster operations, and help segregate costs, too.
Introducing a community recipe library for HPC infrastructure on AWS
Today we’re showing you our community library of HPC Recipes for AWS. It’s a public repo @github that will help you achieve feature-rich, reliable HPC deployments ready to run your workloads no matter where you’re starting from.
Deep-dive into Hpc7a, the newest AMD-powered member of the HPC instance family
Today we discuss the performance results we saw from the new hpc7a instance, running HPC workloads like CFD, molecular dynamics, and weather prediction codes.
Call for participation: RADIUSS Tutorial Series 2023
Lawrence Livermore National Laboratory (LLNL) and AWS are again joining forces to provide a training opportunity for emerging HPC tools and application. In this post you’ll find out the details of those tutorials, and find out how to participate.