AWS ParallelCluster support for Amazon FSx Lustre
Customers using AWS ParallelCluster to set up their High Performance Computing (HPC) clusters can now automatically create a new Amazon FSx for Lustre file system, or specify an existing Amazon FSx for Lustre file system to use, as part of the cluster creation process. With this feature AWS ParallelCluster further reduces the operational overhead of cluster management and simplifies running HPC workloads on AWS.
HPC clusters are collections of tightly coupled compute, storage, and networking resources that enable customers to run large scale scientific and engineering workloads. AWS ParallelCluster is a fully supported and maintained open source cluster management tool that makes it easy for scientists, researchers, and IT administrators to deploy and manage HPC clusters on AWS. AWS ParallelCluster is available at no additional charge, and you pay only for the AWS resources needed to run your applications.
Amazon FSx for Lustre provides high-performance file systems that are optimized for workloads such as HPC, machine learning, analytics, electronic design automation, and media processing. These workloads commonly require data to be presented via a fast and scalable POSIX-compliant file system interface and typically have input data sets that are stored on durable, long-term data stores like Amazon S3. Amazon FSx for Lustre provides sub-millisecond access to your data and allows you to read and write data at speeds of up to hundreds of GBs per second. FSx for Lustre integrates natively with Amazon S3, making it easy for you to process HPC data sets stored in Amazon S3. You can also use Amazon FSx for Lustre as a standalone high-performance file system for workloads you burst to the cloud. By copying on-premises data to an FSx for Lustre file system, you can make that data available for fast processing by compute instances running on AWS.
Learn more about using Amazon FSx for Lustre with AWS ParallelCluster here.