AWS Storage Blog

New – Amazon S3 Batch Operations

We recently announced that Amazon S3 Batch Operations is generally available.

S3 Batch Operations is a new feature that makes it simple for customers to manage billions of objects stored in Amazon S3, with a single API request or a few clicks in the S3 Management Console. Now, all AWS customers can make changes to object properties and metadata, and perform other storage management tasks – such as copying objects between buckets, replacing tag sets, modifying access controls, and restoring archived objects from Amazon S3 Glacier – for any number of S3 objects in minutes instead of months.

With S3 Batch Operations, customers can save up to three months of development time and resources, typically required to write custom application software, in order to perform desired API actions on S3 objects in bulk. Customers can also use the feature to run custom AWS Lambda functions across billions, or even trillions, of S3 objects to execute more complex tasks, such as processing data or transcoding image files. S3 Batch Operations manages retries, tracks progress, sends notifications, generates completion reports, and delivers events to AWS CloudTrail for all changes made and tasks executed.

To get started, customers can specify a list of target objects by using an S3 inventory report, which lists all objects within an S3 bucket or prefix, or by providing their own list of target objects. Then, in the S3 Management Console, a customer can select the desired API action from the pre-populated menu of options. S3 Batch Operations then makes the requested changes against the list of target objects. When complete, S3 Batch Operations sends the customer a notification and automatically generates a completion report that itemizes the changes made.

S3 Batch Operations is available in all AWS commercial regions except for Asia Pacific (Osaka). S3 Batch Operations is also available in AWS GovCloud (US) Regions.

Learn More
Here are some resources to help you learn more about S3 Batch Operations:

Read Jeff Barr’s blog.

Documentation – Read about Creating a Job, Batch Operations, and Managing Batch Operations Jobs.

Amazon S3 pricing page

Tutorial Videos – Check out the S3 Batch Operations Video Tutorials to learn how to Create a Job, Manage and Track a Job, and to Grant Permissions.

FAQs

Sean White

Sean White

Sean White leads product marketing for storage at AWS. He enjoys writing about the never ending ways customers use cloud storage, launching new features and innovations that that delight customers, and simplifying the complex. If you have seen and love Buckets the S3 Mascot, then his team helped bring the mascot to life. If you are scared of mascots, then he had nothing to do with it. He is based in Boston, loves spending time with his wife and two kids, formerly watched Boston pro sports teams, but now has more fun coaching the kids. When in Seattle, you can find him at Anchorhead Coffee and Cloudburst Brewing.