AWS Storage Blog
Category: Management Tools
Reduce encryption costs by using Amazon S3 Bucket Keys on existing objects
As more organizations look to operate faster and at scale, they need ways to meet critical compliance requirements and improve data security. Encryption is a critical component of a defense in depth strategy, and when used correctly, can provide an additional layer of protection above basic access control. However, workloads that access millions or billions […]
Read MoreSynchronize your Oracle databases quickly and easily with Amazon FSx for OpenZFS
Synchronizing a fleet of Oracle database environments can become a major operational burden for organizations of all sizes. In this blog post, I explain how you can reduce operational complexity, improve agility, and reduce costs by using Amazon FSx for OpenZFS to clone your Oracle Database data across multiple environments in seconds. IT operations teams […]
Read MoreAutomate the configuration of Amazon S3 Object Lambda to process data as its retrieved
Customers often have multiple applications consuming information from a single dataset stored in Amazon S3, but each application requires different variations to meet their specific needs. For example, one application may require that data be in a redacted CSV format, while another application requires unredacted information. As another example, a stock image website may require […]
Read MoreEnhanced disaster recovery monitoring with CloudEndure and Amazon CloudWatch
Update (March 4, 2022): Updated Amazon CloudWatch events section to utilize Amazon EventBridge rules instead, allowing you to further customize your serverless event architecture. AWS is also deprecating the requests module in botocore to improve flexibility and performance, and added the ability to use Layers within AWS Lambda to continue using this module. Code has […]
Read MoreCopying objects greater than 5 GB with Amazon S3 Batch Operations
Update: Added support for Glacier Instant Retrieval storage class on March 4th, 2022, and included the copy destination prefix parameter in the Amazon CloudFormation template on April 19th, 2022. A large number of customers store their data in Amazon S3, and some of these customers scale to millions or billions of individual objects. Amazon S3 […]
Read MoreMonitoring and understanding Amazon EBS performance using Amazon CloudWatch
Storage and compute are the main pillars of many different types of applications, making them important to monitor and understand when optimizing or developing an application for peak performance. Amazon EBS is an easy-to-use, scalable, high-performance block-storage service designed for Amazon EC2. EBS is the main type of storage used by applications for high performance transaction-based […]
Read MoreHow to retain resource tags in AWS Backup restore jobs
UPDATE: An updated version of this post was published on 2/3/2022 to extend the source code to support AWS Backup for S3. AWS customers use tags to track ownership of resources, drive cost allocation processes, control access to resources via IAM policies, implement compliance programs, and support operational activities. AWS has provided customers with comprehensive tagging best practices […]
Read MoreEnforcing ownership of Amazon S3 objects in a multi-account environment
Today, Amazon S3 hosts over 100 trillion objects and regularly peaks at tens of millions of requests per second. As the set of use cases for S3 has expanded, our customers have asked us for new ways to regulate access to their mission-critical buckets and objects. For example, with a data lake hosted on Amazon […]
Read MoreSynchronizing your data to Amazon S3 using AWS DataSync
There are many factors to consider when migrating data from on premises to the cloud, including speed, efficiency, network bandwidth and cost. A common challenge many organizations face is choosing the right utility to copy large amounts of data from on premises to an Amazon S3 bucket. I often see cases in which customers start with a free […]
Read MoreConfiguring your FTPS server behind a firewall or NAT with AWS Transfer Family
AWS customers sometimes host AWS Transfer Family endpoints in network address translation (NAT) architectures. One common reason to host the AWS Transfer endpoint behind a NAT is to protect the server with a firewall offered by an AWS Marketplace partner. With the SFTP protocols, there are generally no major issues with using NAT architectures and […]
Read More