New – Amazon S3 Batch Operations

We recently announced that Amazon S3 Batch Operations is generally available.

S3 Batch Operations is a new feature that makes it simple for customers to manage billions of objects stored in Amazon S3, with a single API request or a few clicks in the S3 Management Console. Now, all AWS customers can make changes to object properties and metadata, and perform other storage management tasks – such as copying objects between buckets, replacing tag sets, modifying access controls, and restoring archived objects from Amazon S3 Glacier – for any number of S3 objects in minutes instead of months.

With S3 Batch Operations, customers can save up to three months of development time and resources, typically required to write custom application software, in order to perform desired API actions on S3 objects in bulk. Customers can also use the feature to run custom AWS Lambda functions across billions, or even trillions, of S3 objects to execute more complex tasks, such as processing data or transcoding image files. S3 Batch Operations manages retries, tracks progress, sends notifications, generates completion reports, and delivers events to AWS CloudTrail for all changes made and tasks executed.

To get started, customers can specify a list of target objects by using an S3 inventory report, which lists all objects within an S3 bucket or prefix, or by providing their own list of target objects. Then, in the S3 Management Console, a customer can select the desired API action from the pre-populated menu of options. S3 Batch Operations then makes the requested changes against the list of target objects. When complete, S3 Batch Operations sends the customer a notification and automatically generates a completion report that itemizes the changes made.

S3 Batch Operations is available in all AWS commercial regions except for Asia Pacific (Osaka). S3 Batch Operations is also available in AWS GovCloud (US) Regions.

Learn More
Here are some resources to help you learn more about S3 Batch Operations:

Read Jeff Barr’s blog.

Documentation – Read about Creating a Job, Batch Operations, and Managing Batch Operations Jobs.

Amazon S3 pricing page

Tutorial Videos – Check out the S3 Batch Operations Video Tutorials to learn how to Create a Job, Manage and Track a Job, and to Grant Permissions.

FAQs