AWS HPC Blog

Josiah Bjorgaard

Author: Josiah Bjorgaard

Dr. Josiah Bjorgaard is a Senior Partner Solutions Architect at AWS. He works with AWS Partners to dive deep into customer experiences and develop technical partnerships, resulting in joint well-architected solutions that drive business growth. He has over 10 years of experience in high-performance, scientific, quantum, and cloud computing. He holds a PhD in Physical Chemistry and was a postdoctoral fellow at the Center for Nonlinear Studies at LANL.

Figure 1. Architecture of Slurm and user workflows, demonstrating two methods of interacting with Slurm. In the first method, the user accesses the Head Node via SSH and runs helper scripts like sinfo, squeue, sbatch, and scontrol. In the second method, the user issues REST API calls through HTTP to slurmrestd.

Using the Slurm REST API to integrate with distributed architectures on AWS

The Slurm Workload Manager by SchedMD is a popular HPC scheduler and is supported by AWS ParallelCluster, an elastic HPC cluster management service offered by AWS. Traditional HPC workflows involve logging into a head node and running shell commands to submit jobs to a scheduler and check job status. Modern distributed systems often use representational […]