Tag: Amazon Simple Storage Service (Amazon S3)

Today, Amazon S3 hosts over 100 trillion objects and regularly peaks at tens of millions of requests per second. As the set of use cases for S3 has expanded, our customers have asked us for new ways to regulate access to their mission-critical buckets and objects. For example, with a data lake hosted on Amazon […]

There are many factors to consider when migrating data from on premises to the cloud, including speed, efficiency, network bandwidth and cost. A common challenge many organizations face is choosing the right utility to copy large amounts of data from on premises to an Amazon S3 bucket. I often see cases in which customers start with a free […]

UPDATE (2/10/2022): Amazon S3 Batch Replication launched on 2/8/2022, allowing you to replicate existing S3 objects and synchronize your S3 buckets. See the S3 User Guide for additional details. Customers are increasingly building multi-region applications where they keep multiple copies of their data in geographically isolated locations for reduced latency, compliance, security, disaster recovery, and […]

Update (6/14/2022): The “Copying objects across accounts” section has been updated to reflect the new Amazon S3 Object Ownership feature, an S3 bucket-level setting that you can use to disable access control lists (ACLs) and take ownership of every object in your bucket. You no longer need to configure your cross-account AWS DataSync task to […]

A challenge for many enterprises with data at the scale of petabytes is managing and taking actions on their data to migrate, improve efficiency, and drive down costs through automation. Amazon S3 buckets can hold billions of objects and exabytes of data, letting you build your applications with the ability to grow and scale as […]

Object storage gives you virtually unlimited scale, which helps you grow your business without being concerned with managing the infrastructure to support your data. Managing millions to billions of objects in Amazon S3 can be difficult, inefficient, and time consuming if you don’t take steps to automate the management of this data at scale. Data […]

UPDATE (2/10/2022): Amazon S3 Batch Replication launched on 2/8/2022, allowing you to replicate existing S3 objects and synchronize your S3 buckets. See the S3 User Guide for additional details. The need for data synchronization in Amazon S3 comes up in a number of scenarios for customers – enabling a new geographic region for end users, […]

Today we are excited to announce support for direct local access to S3 on Outposts buckets. You can now run applications in an on-premises network and access objects from S3 on Outposts buckets running on your AWS Outposts. Common use cases for S3 on Outposts involve localized data ingest, processing, and data residency. For example, […]

This is the second of a two-part series on how Pinterest and AWS worked together to solve a complex data access problem. Note: The launch for S3 Access Points aliases on 7/26/2021 makes it easy to use an access point for any application that requires an S3 bucket name. Researchers from the Kellogg School of […]

This is the first of a two-part series on how Pinterest and AWS forged a grassroots collaboration to solve a complex data access problem.  In November 2020, Pinterest sent a note to AWS reporting something “surprising and inspiring:” Pinterest had begun using its new data access control system, built on Amazon S3 Access Points, to […]