Posted On: Nov 28, 2018
Amazon FSx for Lustre is a fully managed file system that is optimized for compute-intensive workloads, such as high-performance computing and machine learning. You can leverage the scale and performance of FSx for Lustre to process your file-based data sets from Amazon S3 or other durable data stores.
With Amazon FSx for Lustre, you can launch and run a Lustre file system that can process massive data sets at up to hundreds of gigabytes per second of throughput, millions of IOPS, and sub-millisecond latencies. FSx for Lustre is seamlessly integrated with Amazon S3, making it easy to link your long-term data sets with your high-performance file systems to run compute-intensive workloads. You can automatically copy data from S3 to FSx for Lustre, run your workloads, and then write results back to S3. FSx for Lustre also enables you to burst your compute-intensive workloads from on-premises to AWS, by allowing you to access your FSx file system over Amazon Direct Connect or VPN.
FSx for Lustre helps you cost-optimize your storage for compute-intensive workloads: It provides cheap and performant non-replicated storage for processing data, with your long-term data stored durably in Amazon S3 or other low-cost data stores. The service is fully managed, eliminating the need for specialized expertise and administrative overhead, like provisioning storage servers.