Posted On: Dec 23, 2019
The Amazon FSx for Lustre CSI driver has reached beta status and is now supported by Amazon Elastic Kubernetes Service (EKS). The CSI driver makes it simple to configure and use FSx for Lustre high performance file systems with containers on EKS and self-managed Kubernetes clusters running on AWS.
Amazon FSx for Lustre is a fully-managed, high performance file system optimized for workloads such as machine learning, high performance computing, video processing, financial modeling, electronic design automation, and analytics. With FSx for Lustre, you can quickly and easily spin up a high-performance file system linked to your S3 data repository, and transparently access S3 objects as files. With the FSx for Lustre CSI driver, you can dynamically provision and mount an FSx for Lustre file system to containers, so that your containerized workloads can natively access and process data stored in the file system or S3 data repository. You can use the CSI driver to mount and share the FSx file system across multiple pods from different nodes.
Containerized applications that require high performance storage can benefit from using the FSx for Lustre file system with this CSI driver. Such applications include distributed machine learning workloads on frameworks such as Tensorflow and PyTorch, and media processing workloads.
To get started, follow the getting started documentation to create a Kubernetes StorageClass and a PersistentVolumeClaim to provision, then reference the PersistentVolumeClaim from the pods that use it. To learn more, you can visit the Amazon EKS product page and the Amazon FSx for Lustre product page.