AWS Storage Blog

Category: Advanced (300)

Encrypting objects with Amazon S3 Batch Operations

Data security keeps your business safe, but encrypting individual files when you manage an extensive data archive can seem daunting. The new Amazon S3 Batch Operations feature lets you perform repetitive or bulk actions like copying or tagging across millions of objects with a single request. All you provide is the list of objects, and […]

Read More

Building an HPC cluster with AWS ParallelCluster and Amazon FSx for Lustre

High performance computing (HPC) customers love the breadth of services offered by AWS and the flexibility offered by the cloud to address their computational challenges. AWS provides you with the opportunity to innovate quickly and accelerate your workflow thanks to a virtually unlimited capacity. For more information, see the following posts: Natural language processing at Clemson […]

Read More

Learn how to use two important Amazon S3 security-features: Block Public Access and S3 Object Lock

Amazon Simple Storage Service (Amazon S3) was AWS’ first Generally Available service when it launched on Pi Day in 2006, and in doing so created cloud storage. It quickly became one of the most important building blocks of AWS infrastructure. Today, S3 is used by millions of customers to store trillions of objects and many […]

Read More

Lift and shift migration of SFTP servers to AWS

At re:Invent 2018, we launched a fully managed service called AWS Transfer for SFTP (AWS SFTP) to enable the migration of file transfer workloads to AWS. We spoke with dozens of customers who were eager to replace their existing SFTP server with a fully managed service backed by storage in the cloud. One of the […]

Read More

Excluding and including specific data in transfer tasks using AWS DataSync filters

AWS DataSync automates and accelerates copying data between your NFS servers, Amazon S3 buckets, and Amazon Elastic File System (Amazon EFS) file systems. With the recent launch of filtering, you can now specify the set of files, folders, or objects that should be transferred, those that should be excluded from the transfer, or a combination […]

Read More

Enable password authentication for AWS Transfer for SFTP using AWS Secrets Manager

Last year at re:Invent we launched AWS Transfer for SFTP (AWS SFTP), a fully managed service that makes it easy to migrate your file transfer workflows to AWS, without changing applications or clients. You can use the service to upload and download files over SFTP directly in and out of Amazon S3. We’ve seen use […]

Read More

Monitor performance of Amazon FSx for Windows File Server with Amazon CloudWatch

Last year I co-authored a post with Helen Lin, Sr. Product Manager for Amazon CloudWatch, when we released Metric Math for Amazon CloudWatch. In that post we showed how easy it is to perform math analytics on your metrics to derive additional insights into the health and performance of your Amazon EFS file systems. Well, […]

Read More

Migrating storage with AWS DataSync

AWS launched AWS DataSync at re:Invent 2018 to simplify and accelerate moving data between on-premises and AWS over the network. Customers are using DataSync for a number of use cases, such as migration, recurring transfers for data processing in AWS, disaster recovery, and one-off transfers of large datasets. After the launch, I heard about how […]

Read More

Turbocharge Amazon S3 with Amazon ElastiCache for Redis

Authored by Michael Labib, Principal Architect, AWS Solutions Architecture with contribution from Sabrinath Rao, Amazon S3 product manager Amazon S3 is the persistent store for applications such as data lakes, media catalogs, and website-related content. These applications often have latency requirements of 10 ms or less, with frequent object requests on 1–10% of the total stored […]

Read More