AWS Storage Blog

Category: Technical How-to

AWS Snow Family Featured Image

Customization and field maintenance with AWS Snowball Edge – sideloading AMIs

When the AWS Snowball Edge launched in 2016, if you wanted to run Amazon Elastic Compute Cloud (Amazon EC2) instances on the device, you were required to specify an Amazon Machine Image (AMI) to be installed on it at time of ordering. You were then able to launch Amazon EC2 instances on the device based […]

Read More
Amazon S3

Monitor Amazon S3 activity using S3 server access logs and Pandas in Python

Monitoring and controlling access to data is often essential for security, cost optimization, and compliance. For these reasons, customers want to know what data of theirs is being accessed, when it is being accessed, and who is accessing it. With more data to monitor, large amounts of data can make it more challenging to granularly […]

Read More
Amazon S3 Glacier Storage Classes

Collecting, archiving, and retrieving surveillance footage with AWS

Video feeds and still images from judiciary locations are considered critical forms of evidence in the court of law. These locations can be police stations and government offices or even civil locations of importance like banks and hospitals. As governments, particularly in smart cities rely upon video surveillance, it is critical to design a cost […]

Read More
Amazon S3

Point-in-time restore for Amazon S3 buckets

Enterprises store increasing quantities of object data for use cases like data lakes, document management systems, and media libraries. Performing point-in-time restores for large datasets can be challenging, as existing approaches with full-restore from backup are time consuming and expensive. Alternatively, restoring individual objects to previous versions is prone to errors and delays the restore […]

Read More

Mount Amazon EFS file systems cross-account from Amazon EKS

Many customers use multiple AWS accounts managed by AWS Organizations to create security and cost boundaries around business units, projects, or applications. AWS Organizations helps you centrally manage and govern your environment as you grow and scale your AWS resources. In some cases, an application in one AWS account must access data in another. As […]

Read More
Amazon S3 Object Lambda

Automate the configuration of Amazon S3 Object Lambda to process data as its retrieved

Customers often have multiple applications consuming information from a single dataset stored in Amazon S3, but each application requires different variations to meet their specific needs. For example, one application may require that data be in a redacted CSV format, while another application requires unredacted information. As another example, a stock image website may require […]

Read More
Site-Merch_Amazon-S3-Lifecycle_Blog

Automate S3 Lifecycle rules at scale to transition data to S3 Intelligent-Tiering

The vast majority of data customers store on Amazon S3 has unknown or changing access patterns, such as data lakes, analytics, and new applications. With these use cases, a dataset can become infrequently and even rarely accessed at specific points in time. The problem is that customers don’t know how data access patterns will change […]

Read More

Automate file retrieval from S3 Glacier when using FSx for Lustre

Customers are running modern high performance computing (HPC) workloads on AWS to process large datasets cost-effectively and optimize performance. These workloads typically rely on a high-performance file system to provide low latency and high throughput access to the data. A performant file system is important so that the file storage can keep up with the […]

Read More
CloudEndure-AWS-Storage-Blog

Tracking CloudEndure Disaster Recovery resources with AWS Cost Explorer and cost allocation tags

CloudEndure Disaster Recovery is a block level replication tool that uses Amazon EC2, Amazon EBS, and EBS Snapshot resources to create a safe and secure disaster recovery solution for customers. The CloudEndure Disaster Recovery console is purpose built to focus on disaster recovery, but does not provide visibility into underlying infrastructure costs. This means that […]

Read More
Site-Merch_Amazon-FSx-for-NetApp_Blog

Enabling multiprotocol workloads with Amazon FSx for NetApp ONTAP

In an enterprise environment, it is common that both Linux and Windows workloads require access to the same data. For example, electronic design automation (EDA) and media and entertainment workloads often involve Windows users accessing data produced by Linux compute instances. Concurrent access to this data requires multiprotocol access: NFS for Linux workloads and SMB […]

Read More