What does this AWS Solutions Implementation do?

The Amazon S3 Glacier Re:Freezer is a serverless solution that automatically copies an entire Amazon S3 Glacier vault's archives to a defined destination Amazon Simple Storage Service (Amazon S3) bucket and S3 storage class. Deploying this solution allows you to seamlessly copy your S3 Glacier vault archives to more cost effective storage locations such as the Amazon S3 Glacier Deep Archive storage class.

sample-cloudwatch-dashboard
Sample Amazon CloudWatch dashboard
The solution deploys a custom Amazon CloudWatch dashboard that provides visibility of the solution's archive copy operation progress.

Benefits

Automation

Automate the optimized restore, copy, and transfer process

Visualization

Launch a prebuilt Amazon CloudWatch dashboard to visualize the copy operation progress

Cost optimization

Seamlessly copy your S3 Glacier vault archives to more cost effective storage locations such as the Amazon S3 Glacier Deep Archive storage class

AWS Solutions Implementation overview

The diagram below presents the architecture you can automatically deploy using the solution's implementation guide and accompanying AWS CloudFormation template.

Amazon S3 Glacier Re:Freezer | Reference Architecture Diagram
 Click to enlarge

Amazon S3 Glacier Re:Freezer Solutions Implementation architecture

The AWS CloudFormation template deploys the following four stages:

  1. Stage one – Get Inventory: The solution obtains the latest Glacier vault inventory file.
  2. Stage two – Request Archives: The solution parses, partitions, and optimizes the Glacier vault inventory file, and then starts the optimized restore order request from Amazon S3 Glacier.
  3. Stage three – Archive Copy: The solution begins the archive copy process to the staging Amazon S3 bucket and Amazon S3 Standard storage class. During the archive copy process, Amazon DynamoDB tracks the status of the archive copies and collects metrics visible in the provided Amazon CloudWatch dashboard.
  4. Stage four – Archive Integrity Check: The solution uses SHA256 Treehash to perform archive integrity checking on the copied object and match it with the SHA256 Treehash as recorded by Amazon S3 Glacier in the Glacier vault inventory list. After the SHA256 Treehash is validated, the object is moved from the staging S3 bucket to the destination S3 bucket and S3 storage class.
 
The AWS CloudFormation template automatically creates AWS Lambda functions which perform the following tasks: 1) request and download the inventory file for the Amazon S3 Glacier vault, 2) request archives from Amazon S3 Glacier vault, 3) perform the archive copy function to the staging Amazon S3 bucket, 4) calculate SHA256 Treehash of copied objects, 5) move the validated objects to the destination Amazon S3 bucket, 6) collect and post metrics to Amazon CloudWatch, and 7) send anonymous statistics to the Solution Builder endpoint (if you elect to send anonymous statistics).
 
For more details about the services that this solution uses, refer to the implementation guide.
 

Amazon S3 Glacier Re:Freezer

Version 1.0.1
Released: 06/2021
Author: AWS

Estimated deployment time: 10 min

Estimated Cost Source Code  CloudFormation template 
Use the button below to subscribe to updates for this Solutions Implementation.
Note: To subscribe to RSS updates, you must have an RSS plug-in enabled for the browser you are using.
Did this Solutions Implementation help you?
Provide feedback 
Build icon
Deploy a Solution yourself

Browse our library of AWS Solutions Implementations to get answers to common architectural problems.

Learn more 
Find an APN partner
Find an APN Partner

Find AWS certified consulting and technology partners to help you get started.

Learn more 
Explore icon
Explore Solutions Consulting Offers

Browse our portfolio of Consulting Offers to get AWS-vetted help with solution deployment.

Learn more