AWS Storage Blog

Category: Open Source

Amazon S3 featured image - new

Accelerate Amazon S3 throughput with the AWS Common Runtime

Data is at the center of every machine learning pipeline. Whether pre-training foundation models (FMs), fine-tuning FMs with business-specific data, or serving inference queries, every step of the machine learning lifecycle needs low-cost, high-performance data storage to keep compute resources busy and performing useful work. Customers use Amazon Simple Storage Service (Amazon S3) to store training data […]

Amazon S3 featured image - new

The inside story on Mountpoint for Amazon S3, a high-performance open source file client

UPDATE (6/30/2023): You can now use the alpha release of Mountpoint for Amazon S3 to create new files in Amazon S3. For details, please read the What’s New post. Amazon S3 is the best place to build data lakes because of its durability, availability, scalability, and security. Hundreds of thousands of data lakes are built […]