AWS Storage Blog

Category: AWS Lambda

AWS Backup 2021 blog image

Use AWS Backup and CI/CD tools to automate centralized backup across AWS services 

Automating and scaling your data protection and backup strategy helps you reduce manual overhead from time-consuming configuration, minimizes the risk for errors, provides visibility on drift detection, and enhances backup policy compliance across distributed AWS workloads or accounts. Incorporating backup in your disaster recovery (DR) and business continuity plan (BCP), along with the automation of […]

Amazon S3 Object Lambda

Modify images cached in Amazon CloudFront using Amazon S3 Object Lambda

Delivering optimized content is critical to a positive end user experience. As data access requirements evolve, the end user may need a transformed version of the original content. The transformations may include masking an image’s metadata, watermarking, or resizing an image before returning it to the user. The object should be stored in its original […]

Amazon S3 Glacier Storage Classes

How Indus OS cost-effectively transitioned billions of small objects between Amazon S3 storage classes

Indus OS is a mobile platform that enables content and application discovery for users, application developers, and original equipment manufacturers (OEMs). Powered by artificial intelligence, Indus App Bazaar curates locally relevant apps and content for users based on their demographics, lingual preferences, and behaviour, and offers an intuitive user interface with content-led discovery. Indus App […]

S3 Intelligent-Tiering

Manage Amazon S3 storage costs granularly and at scale using S3 Intelligent-Tiering

Cost-effective data storage is critical when building and scaling data lakes that manage and hold growing datasets. By choosing the right storage architecture, customers are empowered to quickly experiment and migrate to AWS. Amazon S3 Intelligent-Tiering is a storage class that allows customers to optimize storage costs automatically when data access patterns change without performance […]

AWS Backup 2021 blog image

AWS Backup anomaly detection for Amazon EBS volumes

Protecting your data from cyberattacks and ransomware is a critical responsibility, and taking the necessary steps to detect anomalous activity at every level within your organization can help you keep your data as safe as possible. Data storage is an important area where you can and should deploy anomaly detection. To protect your storage, in […]

Automatic tape deletion with AWS Storage Gateway

Virtual tapes offer a great replacement for cumbersome and expensive physical tapes and are ideal for hybrid workloads looking to take advantage of cloud scale and availability. Virtual tapes can already be less costly than physical tapes and offer more flexibility, less overhead, and better security, but you can save even more money through proper […]

Amazon S3 Batch Operations featured image

Updating Amazon S3 object ACLs at scale with S3 Batch Operations

Access control lists (ACLs) are permission sets associated with data or other system resources that dictate access permissions, and they have been a staple of data security for decades. You may come across a situation where you want to update the ACL on a large number of files, perhaps billions or more. For example, you […]

AWS DataSync Featured Image 2020

How to move and store your genomics sequencing data with AWS DataSync

Genomics data is expanding at a rate exceeding Moore’s law according to the National Human Genome Research Institute. As more sequencing data is produced and researchers move from genotyping to whole genome sequencing, the amount of data produced is outpacing on-premises capacity. Organizations need cloud solutions that help manage data movement, storage, and analysis. The […]

S3 Security

Reduce encryption costs by using Amazon S3 Bucket Keys on existing objects

As more organizations look to operate faster and at scale, they need ways to meet critical compliance requirements and improve data security. Encryption is a critical component of a defense in depth strategy, and when used correctly, can provide an additional layer of protection above basic access control. However, workloads that access millions or billions […]

Amazon EFS serverless featured image

Analytical processing of millions of cell images using Amazon EFS and Amazon S3

Analytical workloads such as batch processing, high performance computing, or machine learning inference often have high IOPS and low latency requirements but operate at irregular intervals on subsets of large datasets. Typically, data is manually copied between storage tiers in preparation of processing, which can be cumbersome and error-prone. Given this, IT teams want to […]