AWS Storage Blog

Tag: Amazon S3 Inventory

Amazon S3

Manage and analyze your data at scale using Amazon S3 Inventory and Amazon Athena

Object storage gives you virtually unlimited scale, which helps you grow your business without being concerned with managing the infrastructure to support your data. Managing millions to billions of objects in Amazon S3 can be difficult, inefficient, and time consuming if you don’t take steps to automate the management of this data at scale. Data […]

Amazon S3 Replication

A step-by-step guide to synchronize data between Amazon S3 buckets

UPDATE (2/10/2022): Amazon S3 Batch Replication launched on 2/8/2022, allowing you to replicate existing S3 objects and synchronize your S3 buckets. See the S3 User Guide for additional details. The need for data synchronization in Amazon S3 comes up in a number of scenarios for customers – enabling a new geographic region for end users, […]

Amazon S3

Building a central asset register with Amazon S3 Inventory

UPDATE 7/12/2022: Amazon SQS policy updated to support every AWS Region (step 3 in the architecture diagram) in the central.yml template. Many AWS customers store millions of objects in their Amazon S3 buckets, due to the scalability, durability, and performance that S3 provides. Customers compelled to build an information asset register for compliance reasons or […]

Amazon S3

Cross-account bulk transfer of files using Amazon S3 Batch Operations

As customers scale their business on AWS, they can have millions to billions of objects in their Amazon S3 buckets. Customers often run operations on a large number of these objects in their buckets, including copying objects across accounts, encrypting objects, or tagging. Running operations on a large number of objects in S3 involves listing […]