AWS HPC Blog
Author: Matt Vaughn
Matt Vaughn is a Principal Developer Advocate for HPC and scientific computing. He has a background in life sciences and building user-friendly HPC and cloud systems for long-tail users. When not in front of his laptop, he’s drawing, reading, traveling the world, or playing with the nearest dog.
Customizing your HPC environment: building AMIs for AWS Parallel Computing Service
Don’t settle for one-size-fits-all HPC. Unlock the power of custom AMIs in AWS Parallel Computing Service. Discover why tailored images are crucial for security, performance, and your workflows
You told us we needed to re-think HPC in the cloud. So we did.
AWS Parallel Computing Service reinvented HPC in the cloud. Learn how we combined familiar HPC tools with the flexibility of the cloud. And walk through what it is, and why it matters.
Jumpstart your HPC journey with the AWS Parallel Computing Service getting started kit
If designing next-gen vehicles or chasing cures is part of your job, don’t miss this. We just launched a major new HPC service to help you scale complex workloads rapidly. Get the details on how AWS Parallel Computing Service can speed up your R&D.
Introducing a community recipe library for HPC infrastructure on AWS
Today we’re showing you our community library of HPC Recipes for AWS. It’s a public repo @github that will help you achieve feature-rich, reliable HPC deployments ready to run your workloads no matter where you’re starting from.
Automate your clusters by creating self-documenting HPC with AWS ParallelCluster
Today we’re going to show you how you can automate cluster deployment and create self-documenting infrastructure at the same time, which leads to more repeatable results that are easier to manage (and replicate).
Customize Slurm settings with AWS ParallelCluster 3.6
With AWS ParallelCluster 3.6, you can directly specify Slurm settings in the cluster config file – improving reproducibility and another step towards self-documentation for your HPC infrastructure.
Introducing GPU health checks in AWS ParallelCluster 3.6
AWS ParallelCluster 3.6.0 can now detect GPU failures in HPC and AI/ML tasks. Health checks run at the start of Slurm jobs and if they fail, the job is requeued on another instance. This can increase reliability and prevent wasted spend.
Install optimized software with Spack configs for AWS ParallelCluster
Today, we’re announcing the availability of Spack configs for AWS ParallelCluster. You can use these configurations to install optimized HPC applications quickly and easily on your AWS-powered HPC clusters.
Multiple Availability Zones now supported in AWS ParallelCluster 3.4
In AWS ParallelCluster 3.4, you can now build HPC clusters that span multiple Amazon EC2 Availability Zones. In this post, we describe how the new feature works, how to use it, and some implications for cluster design that it raises.
Leveraging Slurm Accounting in AWS ParallelCluster
Slurm accounting adds flexibility, transparency, and control to operating an #HPC cluster. #AWS #ParallelCluster 3.3.0 can now automatically configure #Slurm accounting whether you are using your own database or Amazon #Aurora.