AWS Storage Blog

Category: Advanced (300)

Deploy a highly available AWS Storage Gateway on a VMware vSphere cluster

Introduction Tens of thousands of customers are using AWS Storage Gateway today for business-critical applications. By providing common storage protocols such as iSCSI, NFS, SMB, and iSCSI VTL, Storage Gateway makes it easy for customers to continue using their existing applications while taking advantage of virtually unlimited cloud storage. Customers use Storage Gateway to simplify […]

Read More

Automate restore of archived objects through AWS Storage Gateway

AWS Customers who have on-premises file-based applications love having the ability to deploy an AWS Storage Gateway in File Gateway mode, giving them access to virtually unlimited storage in Amazon Simple Storage Service (Amazon S3). The contents of their Amazon S3 buckets are presented to them by File Gateway as files through commonly used storage […]

Read More

Transferring files from on-premises to AWS and back without leaving your VPC using AWS DataSync

AWS DataSync is a service we launched at re:Invent 2018 to simplify, automate, and accelerate data transfer between on-premises storage and AWS, such as Amazon Elastic File System (EFS) and Amazon S3. We recently expanded the service to support direct transfers to all S3 storage classes. Many of our customers are using DataSync to migrate […]

Read More

Simplify Your AWS SFTP Structure with Chroot and Logical Directories

In my last blog post, I showed how you can easily setup AWS Secrets Manager as an identity provider for AWS Transfer for SFTP (AWS SFTP) and enable password authentication. This post discusses how you can leverage that identity provider setup to pass configuration information of a virtual namespace for your users using a new […]

Read More

Register for the free AWS Tech Talk – Amazon S3 Storage Classes and Management Tools

Sign-up to attend the AWS Tech Talk on September 24 at 9:00 AM – 10:00AM PT focused on Amazon S3 Storage Classes and Management Tools. As your data lake grows, it becomes increasingly important to manage objects at scale and optimize storage costs and resources. In this tech talk, AWS experts provide an overview of […]

Read More

Maximizing Microsoft SQL Server Performance with Amazon EBS

AWS customers have been running mission-critical Windows workloads, like SQL Server, on AWS for more than 10 years. In this post, I discuss how to maximize SQL Server performance with Amazon EBS storage. Persistent block storage is a critical component of a relational database management system (RDBMS) and is ultimately responsible for the speed, security, […]

Read More
S3 Batch Operations

Transcoding video files with S3 Batch Operations

The ability to work quickly in bulk—to work smarter rather than harder—is vital for the practical storage management of modern video archives, which can easily be petabytes of data. S3 Batch Operations is an Amazon S3 feature that can perform actions like copying or tagging objects across millions or billions of objects with a single […]

Read More
S3 Batch Operations

Encrypting objects with Amazon S3 Batch Operations

Data security keeps your business safe, but encrypting individual files when you manage an extensive data archive can seem daunting. The new Amazon S3 Batch Operations feature lets you perform repetitive or bulk actions like copying or tagging across millions of objects with a single request. All you provide is the list of objects, and […]

Read More

Building an HPC cluster with AWS ParallelCluster and Amazon FSx for Lustre

High performance computing (HPC) customers love the breadth of services offered by AWS and the flexibility offered by the cloud to address their computational challenges. AWS provides you with the opportunity to innovate quickly and accelerate your workflow thanks to a virtually unlimited capacity. For more information, see the following posts: Natural language processing at Clemson […]

Read More
S3 Security

Learn how to use two important Amazon S3 security-features: Block Public Access and S3 Object Lock

Amazon Simple Storage Service (Amazon S3) was AWS’ first Generally Available service when it launched on Pi Day in 2006, and in doing so created cloud storage. It quickly became one of the most important building blocks of AWS infrastructure. Today, S3 is used by millions of customers to store trillions of objects and many […]

Read More