AWS Storage Blog

Tag: Amazon Simple Storage Service (Amazon S3)

Amazon S3

Enforcing ownership of Amazon S3 objects in a multi-account environment

Today, Amazon S3 hosts over 100 trillion objects and regularly peaks at tens of millions of requests per second. As the set of use cases for S3 has expanded, our customers have asked us for new ways to regulate access to their mission-critical buckets and objects. For example, with a data lake hosted on Amazon […]

Read More
AWS DataSync Featured Image 2020

Synchronizing your data to Amazon S3 using AWS DataSync

There are many factors to consider when migrating data from on premises to the cloud, including speed, efficiency, network bandwidth and cost. A common challenge many organizations face is choosing the right utility to copy large amounts of data from on premises to an Amazon S3 bucket. I often see cases in which customers start with a free […]

Read More
Amazon S3 Replication

Save 20% on storage costs for replicated data in multi-region applications

UPDATE (2/10/2022): Amazon S3 Batch Replication launched on 2/8/2022, allowing you to replicate existing S3 objects and synchronize your S3 buckets. See the S3 User Guide for additional details. Customers are increasingly building multi-region applications where they keep multiple copies of their data in geographically isolated locations for reduced latency, compliance, security, disaster recovery, and […]

Read More
AWS DataSync Featured Image 2020

How to use AWS DataSync to migrate data between Amazon S3 buckets

Update (6/14/2022): The “Copying objects across accounts” section has been updated to reflect the new Amazon S3 Object Ownership feature, an S3 bucket-level setting that you can use to disable access control lists (ACLs) and take ownership of every object in your bucket. You no longer need to configure your cross-account AWS DataSync task to […]

Read More
Amazon S3

Data management at scale using Amazon S3 Batch Operations

A challenge for many enterprises with data at the scale of petabytes is managing and taking actions on their data to migrate, improve efficiency, and drive down costs through automation. Amazon S3 buckets can hold billions of objects and exabytes of data, letting you build your applications with the ability to grow and scale as […]

Read More
Amazon S3

Manage and analyze your data at scale using Amazon S3 Inventory and Amazon Athena

Object storage gives you virtually unlimited scale, which helps you grow your business without being concerned with managing the infrastructure to support your data. Managing millions to billions of objects in Amazon S3 can be difficult, inefficient, and time consuming if you don’t take steps to automate the management of this data at scale. Data […]

Read More
Amazon S3 Replication

A step-by-step guide to synchronize data between Amazon S3 buckets

UPDATE (2/10/2022): Amazon S3 Batch Replication launched on 2/8/2022, allowing you to replicate existing S3 objects and synchronize your S3 buckets. See the S3 User Guide for additional details. The need for data synchronization in Amazon S3 comes up in a number of scenarios for customers – enabling a new geographic region for end users, […]

Read More
S3 on Outposts

Run applications on premises and access Amazon S3 objects from AWS Outposts

Today we are excited to announce support for direct local access to S3 on Outposts buckets. You can now run applications in an on-premises network and access objects from S3 on Outposts buckets running on your AWS Outposts. Common use cases for S3 on Outposts involve localized data ingest, processing, and data residency. For example, […]

Read More
S3 Access Points

Tips for effective innovation collaboration from Pinterest and AWS: Part 2

This is the second of a two-part series on how Pinterest and AWS worked together to solve a complex data access problem. Note: The launch for S3 Access Points aliases on 7/26/2021 makes it easy to use an access point for any application that requires an S3 bucket name. Researchers from the Kellogg School of […]

Read More
S3 Access Points

How Pinterest worked with AWS to create a new way to manage data access: Part 1

This is the first of a two-part series on how Pinterest and AWS forged a grassroots collaboration to solve a complex data access problem.  In November 2020, Pinterest sent a note to AWS reporting something “surprising and inspiring:” Pinterest had begun using its new data access control system, built on Amazon S3 Access Points, to […]

Read More