Posted On: Aug 9, 2023
Today, AWS announces the general availability of Mountpoint for Amazon S3, a new open source file client that delivers high-throughput access to Amazon Simple Storage Service (Amazon S3), lowering processing times and compute costs for data lake applications. Mountpoint for Amazon S3 is a file client that translates local file system API calls to S3 object API calls such as GET and PUT.
Mountpoint for Amazon S3 is ideal for workloads that read large datasets (terabytes to petabytes in size) and require the elasticity and high throughput of Amazon S3. Common use cases include machine learning training as well as reprocessing and validation in autonomous vehicle data processing. These workloads read large datasets over several compute instances and write sequentially to a file from a single process or thread. Mountpoint for Amazon S3 supports sequential and random read operations on existing files and sequential write operations for creating new files. For details on supported file system operations with this release, read the documentation.
Mountpoint for Amazon S3 is an open source project. We welcome your contributions and your feedback on our roadmap, which outlines the plan for adding new capabilities to Mountpoint for Amazon S3. Mountpoint for Amazon S3 is backed by AWS support, which means customers with AWS Business and Enterprise Support plans get 24/7 access to cloud support engineers. To learn more, read the AWS News Blog and visit Mountpoint for Amazon S3.