Category: Technical How-to

UPDATE (2/3/2022): Source code extended to support AWS Backup for Amazon S3. UPDATE (6/24/2022): Source code updated to support tag extraction to support cost allocation reporting. UPDATE (10/1/2025): This post has been updated to use Python 3.12. Customers treat data as an asset and look to protect their data assets through data protection mechanisms. Customers […]

Migrating billions of small files to the cloud can be challenging because of the time and cost required to do so. Solutions that move small files to the cloud – whether online or offline — can exponentially increase cost. This is primarily due to the size of each individual file being migrated. For clarity, a […]

Update (March 4, 2022): Updated Amazon CloudWatch events section to utilize Amazon EventBridge rules instead, allowing you to further customize your serverless event architecture. AWS is also deprecating the requests module in botocore to improve flexibility and performance, and added the ability to use Layers within AWS Lambda to continue using this module. Code has […]

Update (3/4/2022): Added support for Glacier Instant Retrieval storage class. Update (4/19/2022): Included the copy destination prefix parameter in the Amazon CloudFormation template. Update (10/26/2022): Added performance guidance and best practices, and included template optimized for copying objects restored from archive to a different storage class. Update (4/23/2025): Upgraded AWS Lambda function Python runtime to […]

Storage and compute are the main pillars of many different types of applications, making them important to monitor and understand when optimizing or developing an application for peak performance. Amazon EBS is an easy-to-use, scalable, high-performance block-storage service designed for Amazon EC2. EBS is the main type of storage used by applications for high performance transaction-based […]

When dealing with backups, data managers frequently ask, “how do I prevent my backups from being accidentally or maliciously deleted?” or “what can I do to enhance protection against ransomware?” In highly regulated industries, WORM* (write-once-read-many) compliance is required for backups and archives. WORM compliance means immutability and an immutable backup helps in the recovery […]

Sharing data is at the core of collaboration efforts sparking innovation. Many industries rely on secure data access solutions that scale with their business. From pharmaceutical companies exchanging research data with partners in Amazon S3, to financial customers migrating and modernizing transaction data with traditional file transfer protocols, there is a persistent ask for fine-grained […]

Customers often choose to move large amounts of on-premises data to Amazon S3 Glacier. These customers choose to use S3 Glacier for its ability to reliably and securely store any amount of data at a cost-effective price, while being designed for 11 9’s of data durability. This makes S3 Glacier a popular choice for long-term […]

Many customers across several industries use Dell EMC PowerScale to store various kinds of files over SMB, NFS, and HDFS protocols. Common workflows include building and analyzing data lakes, content production creation, genomics sequencing, and image rendering. Implementing and maintaining an efficient and secure data backup for Dell EMC PowerScale in the cloud is necessary […]

To accommodate anticipated service growth in the future, Amazon Elastic File System (Amazon EFS) is migrating to longer format, 17-character resource IDs for its file systems and mount targets. You can opt into this change today, by using the Amazon EFS console, AWS Command Line Interface (CLI), or Amazon EFS API. The switch-over to long […]