AWS Storage Blog
Tag: Amazon Simple Storage Service (Amazon S3)
Enforcing ownership of Amazon S3 objects in a multi-account environment
Today, Amazon S3 hosts over 100 trillion objects and regularly peaks at tens of millions of requests per second. As the set of use cases for S3 has expanded, our customers have asked us for new ways to regulate access to their mission-critical buckets and objects. For example, with a data lake hosted on Amazon […]
Read MoreSynchronizing your data to Amazon S3 using AWS DataSync
There are many factors to consider when migrating data from on premises to the cloud, including speed, efficiency, network bandwidth and cost. A common challenge many organizations face is choosing the right utility to copy large amounts of data from on premises to an Amazon S3 bucket. I often see cases in which customers start with a free […]
Read MoreSave 20% on storage costs for replicated data in multi-region applications
UPDATE (2/10/2022): Amazon S3 Batch Replication launched on 2/8/2022, allowing you to replicate existing S3 objects and synchronize your S3 buckets. See the S3 User Guide for additional details. Customers are increasingly building multi-region applications where they keep multiple copies of their data in geographically isolated locations for reduced latency, compliance, security, disaster recovery, and […]
Read MoreHow to use AWS DataSync to migrate data between Amazon S3 buckets
Update (6/14/2022): The “Copying objects across accounts” section has been updated to reflect the new Amazon S3 Object Ownership feature, an S3 bucket-level setting that you can use to disable access control lists (ACLs) and take ownership of every object in your bucket. You no longer need to configure your cross-account AWS DataSync task to […]
Read MoreData management at scale using Amazon S3 Batch Operations
A challenge for many enterprises with data at the scale of petabytes is managing and taking actions on their data to migrate, improve efficiency, and drive down costs through automation. Amazon S3 buckets can hold billions of objects and exabytes of data, letting you build your applications with the ability to grow and scale as […]
Read MoreManage and analyze your data at scale using Amazon S3 Inventory and Amazon Athena
Object storage gives you virtually unlimited scale, which helps you grow your business without being concerned with managing the infrastructure to support your data. Managing millions to billions of objects in Amazon S3 can be difficult, inefficient, and time consuming if you don’t take steps to automate the management of this data at scale. Data […]
Read MoreA step-by-step guide to synchronize data between Amazon S3 buckets
UPDATE (2/10/2022): Amazon S3 Batch Replication launched on 2/8/2022, allowing you to replicate existing S3 objects and synchronize your S3 buckets. See the S3 User Guide for additional details. The need for data synchronization in Amazon S3 comes up in a number of scenarios for customers – enabling a new geographic region for end users, […]
Read MoreRun applications on premises and access Amazon S3 objects from AWS Outposts
Today we are excited to announce support for direct local access to S3 on Outposts buckets. You can now run applications in an on-premises network and access objects from S3 on Outposts buckets running on your AWS Outposts. Common use cases for S3 on Outposts involve localized data ingest, processing, and data residency. For example, […]
Read MoreTips for effective innovation collaboration from Pinterest and AWS: Part 2
This is the second of a two-part series on how Pinterest and AWS worked together to solve a complex data access problem. Note: The launch for S3 Access Points aliases on 7/26/2021 makes it easy to use an access point for any application that requires an S3 bucket name. Researchers from the Kellogg School of […]
Read MoreHow Pinterest worked with AWS to create a new way to manage data access: Part 1
This is the first of a two-part series on how Pinterest and AWS forged a grassroots collaboration to solve a complex data access problem. In November 2020, Pinterest sent a note to AWS reporting something “surprising and inspiring:” Pinterest had begun using its new data access control system, built on Amazon S3 Access Points, to […]
Read More