AWS Storage Blog

Category: Advanced (300)

Amazon S3

Building a central asset register with Amazon S3 Inventory

UPDATE 7/12/2022: Amazon SQS policy updated to support every AWS Region (step 3 in the architecture diagram) in the central.yml template. Many AWS customers store millions of objects in their Amazon S3 buckets, due to the scalability, durability, and performance that S3 provides. Customers compelled to build an information asset register for compliance reasons or […]

Persistent storage for container logging using Fluent Bit and Amazon EFS

UPDATE 9/8/2021: Amazon Elasticsearch Service has been renamed to Amazon OpenSearch Service. See details. Logging is a powerful debugging mechanism for developers and operations teams when they must troubleshoot issues. Containerized applications write logs to standard output, which is redirected to local ephemeral storage, by default. These logs are lost when the container is terminated […]

Building an IoT solution at the edge with AWS Snowcone

UPDATE: The second blog post in this two-post series was published on January 5, 2020. Internet of Things (IoT) applications, like other applications, require edge solutions to operate in austere conditions with limited network connectivity or limited infrastructure. IoT applications at the edge can span numerous uses, like automation, optimization, and intelligent manufacturing to name […]

Easy-to-use Amazon EFS integrations with AWS Compute services

Every day AWS customers launch Amazon EC2 instances using the Launch Instance Wizard (LIW). When launching instances to host applications like content management systems, data science notebooks, database backups, media workflows, and code repositories, you create and attach shared file systems like Amazon EFS to your instances. In the past, creating and attaching new Amazon […]

Amazon S3

Managing Amazon S3 access with VPC endpoints and S3 Access Points

Many customers own multiple Amazon S3 buckets, some of which are accessed by applications running in VPCs. Amazon Virtual Private Cloud (Amazon VPC) enables you to launch AWS resources into a virtual network that you define. This virtual network closely resembles a traditional network that you’d operate in your own data center, with the benefits […]

Amazon S3

Migrating and managing large datasets on Amazon S3 (Part 1)

UPDATE: The second post in this two-part series was published on October 29th, 2020. This is the first of a two-post series intended for customers migrating and managing large datasets on Amazon S3. This post addresses moving your data to S3 and choosing the optimal storage class for your data. The second follow-on post (coming […]

Centralized cross-account management with Cross-Region copy using AWS Backup

Many organizations begin their cloud journey with a single AWS account and gradually expand their cloud presence into a multi-account environment for regulatory, compliance, security, or cost tracking purposes. Organizations often choose to deploy workloads and applications in multiple Regions on AWS Global Infrastructure for high availability, scalability, and performance. Building and operating in multi-account […]

CloudEndure-AWS-Storage-Blog

Migrating workloads across AWS Regions with CloudEndure Migration

AWS customers are in various stages of their cloud journey. Frequently, enterprises begin that journey by rehosting (lift-and-shift migrating) their on-premises workloads into AWS and running on our Amazon EC2 instances. Many of these customers perform that rehosting using CloudEndure Migration, our cloud-native migration tool. However, this rehosting migration pattern with CloudEndure Migration can also […]

AWS DataSync Featured Image

Transferring file data across AWS Regions and accounts using AWS DataSync

Many customers that use Amazon EFS want to replicate their file systems to other AWS accounts or other AWS Regions. Customers may do this for business continuity purposes or to provide low-latency access to data for processes running in other Regions. AWS DataSync makes it easy for customers to replicate data from one Amazon EFS […]