AWS Storage Blog
Category: Launch
Accelerate Amazon S3 throughput with the AWS Common Runtime
Data is at the center of every machine learning pipeline. Whether pre-training foundation models (FMs), fine-tuning FMs with business-specific data, or serving inference queries, every step of the machine learning lifecycle needs low-cost, high-performance data storage to keep compute resources busy and performing useful work. Customers use Amazon Simple Storage Service (Amazon S3) to store training data […]
How to enforce Amazon S3 Access Grants with Immuta
Amazon Simple Storage Service (Amazon S3) is the most popular object storage platform for modern data lakes. Organizations today evolved to adopt a lake house architecture that combines the scalability and cost effectiveness of data lakes with the performance and ease-of-use of data warehouses. Likewise, Amazon S3 plays an increasingly important role as the foundational […]
Scaling data access with Amazon S3 Access Grants
To adhere to the principle of least privilege, users define granular access to their Amazon Simple Storage Service (Amazon S3) data based on applications, personas, groups or organization units (OUs). This practice helps customers to mitigate the risk of unauthorized access, limiting potential damage in case of a security breach as employees only have access […]
Creating compliance insights across Regions and accounts with AWS Backup Audit Manager reports
Customers use AWS Backup Audit Manager to automate continuous monitoring of backup activities such as changes to a backup plan or backup vault and generate daily reports. AWS Backup Audit Manager also provides auditing and reporting of data protection compliance across your backup estate. Previously, these compliance and backup activity reports were generated in and […]
Data preservation with AWS Backup legal holds
Customers globally, especially in regulated industries, require centralized protection and demonstrable compliance for their application data. Auditors often require customers such as broker-dealers, securities exchanges, and stock brokerage firms, to prove compliance with SEC, FINRA, and CFTC requirements by providing an assessment report from an industry-recognized entity with additional disclosure that they have capabilities to […]
Delegated administrator support for AWS Backup
[Update: 12/13/2022 – Under Step 2. Delegate backup policy in AWS Organizations console, the JSON policy paragraph and sample JSON policy were updated.] Until today, backup administrators had to use the AWS Organizations management account to administer backup policies and monitor cross-account backup activities. However, the use of the AWS Organizations management account should only […]
Protect your resources from unintended deletions through Rule Lock for Recycle Bin
Security and data protection are top-of-mind for AWS customers, especially when dealing with business-critical cloud resources. Customers want to protect their production data from accidental data loss as well as from emerging threats like ransomware, malicious insiders or account takeover attacks. On November 23rd, 2022, we added stronger controls to Recycle Bin through the Rule […]
Run queries up to 9x faster using Trino with Amazon S3 Select on Amazon EMR
UPDATE (7/25/2024): Use Amazon Athena, S3 Object Lambda, or client-side filtering to query your data in Amazon S3. Learn more » Customers building data lakes continue to innovate in the ways that they store and access their data. For these customers, performance is critical, particularly when they are accessing large amounts of data. For example, […]
Restoring archived objects at scale from the Amazon S3 Glacier storage classes
Update (7/26/2024): You no longer need to optimize the S3 Inventory report using Amazon Athena. Amazon S3 will automatically optimize your S3 Batch Operations restore job to achieve the fastest retrieval throughput. For more guidance on using batch operations, learn more in the S3 User Guide. Every organization around the world has archival data. There is […]
Customize file delivery notifications using AWS Transfer Family managed workflows
Enterprises and organizations that transfer files, both internally and with external parties, can benefit from having file-processing protocols that facilitate efficient and transparent file-transfer management. When transferring files, especially at scale, it is important to have visibility into the status of file transfer, and for you to able to process files as you receive them. […]