Posted On: Nov 30, 2021
Amazon FSx for Lustre, a service that provides cost-effective, high-performance, scalable file systems for compute workloads, is making it even easier to process data residing in Amazon S3 by enabling an FSx for Lustre file system to be linked to multiple S3 buckets.
Integrated with Amazon S3, FSx for Lustre enables you to easily to process S3 datasets with a high-performance file system. Before today, you could link a file system to a single S3 bucket or prefix and FSx for Lustre transparently presented S3 objects as files. With today’s launch, you can link multiple S3 buckets or prefixes to a file system and your S3 datasets appear as files and directories in a single unified file system namespace.
Support for multiple S3 buckets is available at no additional cost on Amazon FSx for Lustre file systems with Persistent 2 deployment type in US East (N. Virginia), US East (Ohio), US West (Oregon), Canada (Central), Europe (Frankfurt), Europe (Ireland), and Asia Pacific (Tokyo). You can create a file system and link it to multiple S3 buckets by using the AWS Management Console, the AWS CLI, and AWS SDKs. Learn more about using multiple S3 datasets with FSx for Lustre file systems in our AWS News blog, and the Amazon FSx documentation.