Amazon S3 Introduces S3 Batch Operations for Object Management

Posted on: Apr 30, 2019

At AWS re:Invent 2018 we announced preview availability for S3 Batch Operations and today we are announcing general availability. S3 Batch Operations is a new feature that makes it simple for customers to manage billions of objects stored in Amazon S3, with a single API request or a few clicks in the S3 Management Console. Now, all AWS customers can make changes to object properties and metadata, and perform other storage management tasks – such as copying objects between buckets, replacing tag sets, modifying access controls, and restoring archived objects from Amazon S3 Glacier – for any number of S3 objects in minutes instead of months.

With S3 Batch Operations, customers can save up to three months of development time and resources, typically required to write custom application software, in order to perform desired API actions on S3 objects in bulk. Customers can also use the feature to run custom AWS Lambda functions across billions, or even trillions, of S3 objects to execute more complex tasks, such as processing data or transcoding image files. S3 Batch Operations manages retries, tracks progress, sends notifications, generates completion reports, and delivers events to AWS CloudTrail for all changes made and tasks executed.

To get started, customers can specify a list of target objects by using an S3 inventory report, which lists all objects within an S3 bucket or prefix, or by providing their own list of target objects. Then, in the S3 Management Console, a customer can select the desired API action from the pre-populated menu of options. S3 Batch Operations then makes the requested changes against the list of target objects. When complete, S3 Batch Operations sends the customer a notification and automatically generates a completion report that itemizes the changes made.

S3 Batch Operations is available in all AWS commercial regions except for Asia Pacific (Osaka). S3 Batch Operations is also available in AWS GovCloud (US) Regions.

For pricing information, please visit the Amazon S3 pricing page

To learn more about S3 Batch Operations read the blog, watch the video tutorials, visit the documentation, and see our FAQs.