Amazon FSx for Lustre improves directory listing performance by up to 5x
Amazon FSx for Lustre now delivers up to 5x faster directory listing (ls) performance, allowing you to browse and analyze the contents of your file systems more efficiently.
Amazon FSx for Lustre is a high-performance, cost-effective, and scalable file storage service for compute-intensive workloads like machine learning training, financial analytics, and high-performance computing. ML researchers, data scientists, and developers who use FSx for Lustre for compute-intensive workloads commonly use their file systems to store data for interactive use cases like home directories and source code repositories. Today's performance improvement makes FSx for Lustre even faster for these interactive use cases by reducing the time it takes to list and analyze the contents of directories using "ls".
The performance improvements are supported with the latest Lustre 2.15 client in all AWS regions where FSx for Lustre is available. To get started, upgrade to the latest 2.15 client and follow the instructions in the Amazon FSx for Lustre documentation to apply the recommended client tunings.