AWS Storage Blog

Category: AWS CloudFormation

AWS Backup 2021 blog image

Use AWS Backup and CI/CD tools to automate centralized backup across AWS services 

Automating and scaling your data protection and backup strategy helps you reduce manual overhead from time-consuming configuration, minimizes the risk for errors, provides visibility on drift detection, and enhances backup policy compliance across distributed AWS workloads or accounts. Incorporating backup in your disaster recovery (DR) and business continuity plan (BCP), along with the automation of […]

Synchronize your Oracle databases quickly and easily with Amazon FSx for OpenZFS

Synchronizing a fleet of Oracle database environments can become a major operational burden for organizations of all sizes. In this blog post, I explain how you can reduce operational complexity, improve agility, and reduce costs by using Amazon FSx for OpenZFS to clone your Oracle Database data across multiple environments in seconds. IT operations teams […]

Amazon S3 Object Lambda

Automate the configuration of Amazon S3 Object Lambda to process data as its retrieved

Customers often have multiple applications consuming information from a single dataset stored in Amazon S3, but each application requires different variations to meet their specific needs. For example, one application may require that data be in a redacted CSV format, while another application requires unredacted information. As another example, a stock image website may require […]

Amazon S3 Batch Operations featured image

Copying objects greater than 5 GB with Amazon S3 Batch Operations

Update (3/4/2022): Added support for Glacier Instant Retrieval storage class. Update (4/19/2022): Included the copy destination prefix parameter in the Amazon CloudFormation template. Update (10/26/2022):Added performance guidance and best practices, and included template optimized for copying objects restored from archive to a different storage class. A large number of customers store their data in Amazon […]

AWS Backup 2021 blog image

How to retain resource tags in AWS Backup restore jobs

UPDATE (2/3/2022): Source code extended to support AWS Backup for Amazon S3. UPDATE (6/24/2022): Source code updated to read tags from recovery points inline with changes to AWS Backup boto3 APIs. Update (2/23/2023): Fixed bug in source code related to support for Amazon S3 backup restores. AWS customers use tags to track ownership of resources, […]

Amazon S3

Enforcing ownership of Amazon S3 objects in a multi-account environment

Today, Amazon S3 hosts over 100 trillion objects and regularly peaks at tens of millions of requests per second. As the set of use cases for S3 has expanded, our customers have asked us for new ways to regulate access to their mission-critical buckets and objects. For example, with a data lake hosted on Amazon […]

AWS Transfer Family Featured Image

Configuring your FTPS server behind a firewall or NAT with AWS Transfer Family

AWS customers sometimes host AWS Transfer Family endpoints in network address translation (NAT) architectures. One common reason to host the AWS Transfer endpoint behind a NAT is to protect the server with a firewall offered by an AWS Marketplace partner. With the SFTP protocols, there are generally no major issues with using NAT architectures and […]

AWS Transfer Family Featured Image

Using Okta as an identity provider with AWS Transfer Family and Amazon EFS

Earlier this year, AWS Transfer Family launched support for Amazon EFS. With this update, you can grant your end users access to files stored in Amazon EFS file systems using any of the protocols supported by Transfer Family. However, if you use Okta as the identity provider, there are additional considerations during setup. For example, […]

AWS Transfer Family Featured Image

Moving external site data to AWS for file transfers with AWS Transfer Family

Managing a strong, cohesive relationship with third-party vendors and outside partners involves transferring data back-and-forth to facilitate projects and workloads. Transferring data between separate organizations can be challenging, with different infrastructures, policies, and protocols to reconcile. AWS Transfer Family offers fully managed support for transferring files over SFTP, FTPS, and FTP directly into and out […]

AWS Backup 2021 blog image

Automate centralized backup at scale across AWS services using AWS Backup

UPDATE 11/11/2021: Updated to improve the user experience in the walkthrough steps. Reliable and consistent backup of cloud data is important to have a secure data archive and restore in the event of data loss. Traditionally, backup administrators used manual backup procedures that were difficult to scale and lowered productivity, with data distributed across multiple […]