What does this AWS Solutions Implementation do?

Amazon S3 Standard, S3 Standard–IA, S3 One Zone-IA, S3 Intelligent-Tiering, S3 Glacier, and S3 Glacier Deep Archive storage classes are all designed to provide 99.999999999% durability of objects over a given year. These services are designed to sustain concurrent device failures by quickly detecting and repairing any lost redundancy, and they also regularly verify the integrity of data using checksums.

The Serverless Fixity for Digital Preservation Compliance solution makes it easier for customers who require an on-demand fixity check process to validate the checksums for compliance and audit requirements. Using this solution, AWS customers can check the integrity of their objects stored in any Amazon S3 storage class using either the MD5 or SHA1 checksum algorithm without having to incur the cost and complexity of third-party software.

With this solution, you can start the fixity check process using the AWS Management Console, Amazon API Gateway, or the AWS Command Line Interface (CLI). Fixity check results are mailed to subscribers using Amazon Simple Notification Service (Amazon SNS) notifications.

AWS Solutions Implementation overview

The diagram below presents the architecture you can automatically deploy using the solution's implementation guide and accompanying AWS CloudFormation templates.

Serverless Fixity for Digital Preservation Compliance | Architecture Diagram
 Click to enlarge

Serverless Fixity for Digital Preservation Compliance solution architecture

This solution includes an AWS CloudFormation template (serverless-fixity-for-digital-preservation-compliance) you deploy in the account you want to run on-demand automated fixity checks. The template launches an AWS Step Functions state machine, AWS Lambda functions, and Amazon SNS. The AWS Step Functions state machine workflow restores and computes using either an MD5 or SHA1 checksum algorithm, and validates objects stored in your Amazon S3 buckets.

The solution orchestrates the fixity check process in various states. If necessary, the workflow restores the object from the Amazon S3 Glacier or Amazon S3 Glacier Deep Archive storage class. Then, the process incrementally computes the fixity. After the MD5 or SHA1 checksum is calculated, the calculated checksum is validated with the original checksum value stored with the object. The results of the fixity check process are sent to an Amazon SNS topic, which is then sent to subscribers.

The solution also creates an Amazon API Gateway endpoint that provides a RESTful API to start and monitor the fixity check process. The RESTful API requires authentication using valid AWS Identity and Access Management (IAM) credentials. By default, the solution works with Amazon S3 buckets and objects in your existing AWS account in which the solution is deployed.

Serverless Fixity for Digital Preservation Compliance

Version 1.0
Last updated: 12/2019
Author: AWS

Estimated deployment time: 5 min

Use the button below to subscribe to solution updates.

Note: To subscribe to RSS updates, you must have an RSS plug-in enabled for the browser you are using. 

Did this Solutions Implementation help you?
Provide feedback 

Features

Fixity checks using native AWS services

Use the included AWS CloudFormation template to easily perform fixity checking on objects stored in any Amazon S3 storage class using native AWS services.

Flexible fixity check options

Start the fixity checks using the AWS Management Console, Amazon API Gateway, or the CLI.

Meet compliance requirements

Use this solution to meet compliance requirements that require a periodic re-computation and comparison of the checksum against external records of that checksum.

Receive notifications for fixity check results

Receive Amazon SNS notifications with the results of the fixity checks.
Build icon
Deploy a Solution yourself

Browse our library of AWS Solutions Implementations to get answers to common architectural problems.

Learn more 
Find an APN partner
Find an APN Partner

Find AWS certified consulting and technology partners to help you get started.

Learn more 
Explore icon
Explore Solutions Consulting Offers

Browse our portfolio of Consulting Offers to get AWS-vetted help with solution deployment.

Learn more