AWS Storage Blog

Category: Advanced (300)

Managing Amazon S3 access with VPC endpoints and S3 Access Points

Many customers own multiple Amazon S3 buckets, some of which are accessed by applications running in VPCs. Amazon Virtual Private Cloud (Amazon VPC) enables you to launch AWS resources into a virtual network that you define. This virtual network closely resembles a traditional network that you’d operate in your own data center, with the benefits […]

Read More

Online Tech Talk October 1: Data protection at scale with AWS Backup

Don’t miss our AWS Online Storage Tech Talk on October 1, where an AWS expert covers protecting your data at scale with AWS Backup. This Tech Talk is at 9:00 AM – 10:00 AM PT (12:00 PM – 1:00 PM ET). In this tech talk, we cover AWS Backup, a fully managed service for centralizing […]

Read More

Migrating and managing large datasets on Amazon S3 (Part 1)

UPDATE: The second post in this two-part series was published on October 29th, 2020. This is the first of a two-post series intended for customers migrating and managing large datasets on Amazon S3. This post addresses moving your data to S3 and choosing the optimal storage class for your data. The second follow-on post (coming […]

Read More

Centralized cross-account management with Cross-Region copy using AWS Backup

Many organizations begin their cloud journey with a single AWS account and gradually expand their cloud presence into a multi-account environment for regulatory, compliance, security, or cost tracking purposes. Organizations often choose to deploy workloads and applications in multiple Regions on AWS Global Infrastructure for high availability, scalability, and performance. Building and operating in multi-account […]

Read More
CloudEndure-AWS-Storage-Blog

Migrating workloads across AWS Regions with CloudEndure Migration

AWS customers are in various stages of their cloud journey. Frequently, enterprises begin that journey by rehosting (lift-and-shift migrating) their on-premises workloads into AWS and running on our Amazon EC2 instances. Many of these customers perform that rehosting using CloudEndure Migration, our cloud-native migration tool. However, this rehosting migration pattern with CloudEndure Migration can also […]

Read More
AWS DataSync Featured Image

Transferring file data across AWS Regions and accounts using AWS DataSync

Many customers that use Amazon EFS want to replicate their file systems to other AWS accounts or other AWS Regions. Customers may do this for business continuity purposes or to provide low-latency access to data for processes running in other Regions. AWS DataSync makes it easy for customers to replicate data from one Amazon EFS […]

Read More
AWS Outposts Featured Image

Connecting AWS Outposts to on-premises data sources

Millions of customers such as startups, enterprises, and leading government agencies are using AWS to lower costs, become more agile, and innovate faster. There are some workloads that must remain on-premises in order to interact with data that cannot, for variety of reasons, move to an AWS Region. Enter AWS Outposts. AWS Outposts is a […]

Read More

Transferring Amazon S3 data from AWS Regions to AWS Regions in China

AWS customers with data located in multiple AWS Regions often ask about moving files from AWS Regions outside of China to the AWS China (Beijing) Region and the AWS China (Ningxia) Region to localize data within China for compliance, data center operations, and data storage requirements. To best serve customers in China and comply with […]

Read More

Cross-account bulk transfer of files using Amazon S3 Batch Operations

As customers scale their business on AWS, they can have millions to billions of objects in their Amazon S3 buckets. Customers often run operations on a large number of these objects in their buckets, including copying objects across accounts, encrypting objects, or tagging. Running operations on a large number of objects in S3 involves listing […]

Read More

How Qubole optimizes cost and performance by managing shuffle data

Ad hoc analytics, data exploration, data engineering, and machine learning (ML) workloads are often run at a massive scale and require significant computing power, which can be costly. Amazon EC2 Spot Instances, which enable you to use unused Amazon EC2 computing capacity in the AWS Cloud, offer up to 90% in savings over On-Demand Instances. […]

Read More