AWS Storage Blog

Tag: Amazon S3 Batch Operations

Amazon S3 Replication

A step-by-step guide to synchronize data between Amazon S3 buckets

UPDATE (2/10/2022): Amazon S3 Batch Replication launched on 2/8/2022, allowing you to replicate existing S3 objects and synchronize your S3 buckets. See the S3 User Guide for additional details. The need for data synchronization in Amazon S3 comes up in a number of scenarios for customers – enabling a new geographic region for end users, […]

Amazon S3 Glacier featured image

Adding and removing object tags with Amazon S3 Batch Operations

For many organizations, securely and cost-effectively organizing massive amounts of stored data can be a daunting task. Without an easy way to organize data, companies may find themselves exerting a lot of time and energy trying to meet their data storage requirements, potentially slowing down projects and operations. For instance, certain data may need to […]

Amazon S3

Using job tags to manage permissions for Amazon S3 Batch Operations jobs

As organizations grow their use of AWS, they often find that a variety of teams and applications begin to use the data stored in Amazon S3. While customers love the agility benefits of this, they also seek to govern their data’s security, productivity, and cost. Earlier this year we announced support for job tags with […]

Amazon S3

Cross-account bulk transfer of files using Amazon S3 Batch Operations

As customers scale their business on AWS, they can have millions to billions of objects in their Amazon S3 buckets. Customers often run operations on a large number of these objects in their buckets, including copying objects across accounts, encrypting objects, or tagging. Running operations on a large number of objects in S3 involves listing […]

Amazon S3

How to manage retention periods in bulk using Amazon S3 Batch Operations

Amazon S3 Batch Operations now supports S3 Object Lock. In this post, I share ways you can use these two Amazon S3 features together to address common data protection needs. S3 Batch Operations is a feature that lets you perform repetitive or bulk actions like copying or updating tag sets across millions of objects with […]

Amazon S3

Teespring controls its legacy data using Amazon S3

Do you know exactly what’s in all of your Amazon Simple Storage Service (Amazon S3) buckets? Do all of your objects have the correct set of object tags applied? Have you set up lifecycle rules to ensure your current and future objects are managed automatically for you? If you answered “yes” to all of the […]

Amazon S3 Batch Operations featured image

Transcoding video files with S3 Batch Operations

The ability to work quickly in bulk—to work smarter rather than harder—is vital for the practical storage management of modern video archives, which can easily be petabytes of data. S3 Batch Operations is an Amazon S3 feature that can perform actions like copying or tagging objects across millions or billions of objects with a single […]

Amazon S3 Batch Operations featured image

Encrypting objects with Amazon S3 Batch Operations

Update 4/29/2022: A clarification has been made to the pricing paragraph in the “Setting up and running your S3 Batch Operations job” section of this blog post. Data security keeps your business safe, but encrypting individual files when you manage an extensive data archive can seem daunting. The new Amazon S3 Batch Operations feature lets […]