AWS Storage Blog
Category: Foundational (100)
High-performance cloud storage comes of age with Amazon FSx for Lustre
The rapid maturation of cloud tools for high-performance workloads in the past several years has made it possible for household names like T-Mobile, Toyota, and Rivian to move their high-performance analytics and AI/ML environments to the cloud. These are hugely data-intensive workflows that many companies five years ago believed would never be able to be […]
MemQ by Pinterest: An efficient, scalable, cloud-native publish/subscribe system
The Logging Platform at Pinterest powers all data ingestion and transportation at Pinterest. At the heart of the Pinterest Logging Platform are distributed pub/sub systems that help our customers transport, buffer, and consume data asynchronously. Pub/sub messaging, is a form of asynchronous service-to-service communication used in serverless and microservices architectures. In a pub/sub model, any […]
Considering four different replication options for data in Amazon S3
UPDATE (2/10/2022): Amazon S3 Batch Replication, which is not covered in this blog post, launched on 2/8/2022, allowing you to replicate existing S3 objects and synchronize your S3 buckets. See the S3 User Guide for additional details. UPDATE (5/1/2023): Updated the comparison table to reflect the latest capabilities of the mechanisms covered in the table. […]
Best practices for archiving large datasets with AWS
As companies grow, they often find themselves managing an ever-increasing amount of data. Customers often need to retain backups for business continuity or disaster recovery, as well as records for compliance and audits. In addition, some customers may need to retain backups to create a centralized repository of information that is heterogeneous in nature, with […]
AWS Storage Gateway in 2021 – Year in Review
It has become customary for us to share with our customers the new AWS Storage Gateway enhancements every year. As we did in 2020 and 2019, through this blog I’m reviewing all the new Storage Gateway launches from 2021. I’ll cover how the new enhancements make it easier for customers to access AWS Storage from […]
AWS and Tape Ark partner to migrate petabytes of tape data using AWS Snowball with Tape Gateway
The last century has seen some remarkable innovation that has created new possibilities in a wide range of computing areas. Most remarkable of all is that companies around the world can now have all of their data in one place, completely accessible, all of the time. Amazon S3 and all of the S3 storage classes […]
Amazon S3 reduces prices up to 31% for three storage classes
We are excited to announce that Amazon S3 has reduced storage prices up to 31% in three S3 storage classes, effective December 1, 2021. Specifically, we are reducing the storage price for S3 Standard-Infrequent Access and S3 One Zone-Infrequent Access up to 31% in 9 AWS Regions: Asia Pacific (Hong Kong), Asia Pacific (Mumbai), Asia […]
Storing data with AWS Partner solutions and Amazon S3 Glacier Instant Retrieval
Amazon Simple Storage Service (Amazon S3) offers a range of storage classes which are purpose-built to provide the lowest cost storage for different access patterns, and virtually any use case. Today, customers are accumulating petabytes of archive data that is only accessed occasionally and often stored indefinitely, where the data must be highly available and […]
Nine is fine: Amazon EFS sessions at re:Invent 2021
At re:Invent 2021 you’ll enjoy learning, sharing, networking, and fun. The 2021 in-person event is sold out, but not to worry! You can still register for virtual re:Invent. AWS Storage has a big lineup for you this year, starting with our leadership session, “Driving innovation and insight with cloud data on AWS storage,” where you’ll […]
How automated reasoning helps Amazon S3 innovate at scale
When we launched Amazon S3 a little over fifteen years ago, we put simplicity at the center of the customer experience. S3’s core API is just four REST commands (GET, PUT, LIST, and DELETE). Our customers tell us that they love the simplicity of S3 not just because of its API, but especially because of […]