AWS Storage Blog

Category: Compute

Automate restore of archived objects through AWS Storage Gateway

AWS Customers who have on-premises file-based applications love having the ability to deploy an AWS Storage Gateway in File Gateway mode, giving them access to virtually unlimited storage in Amazon Simple Storage Service (Amazon S3). The contents of their Amazon S3 buckets are presented to them by File Gateway as files through commonly used storage […]

Read More

Automate mounting Amazon EFS File Systems from the EC2 Launch Instance Wizard

Customers have provided us with great feedback on previous posts covering best practices and integrations for using Amazon Elastic File System (EFS) with other AWS services, and they have been asking for more. Today, I’ll show you how you can simplify and automate the mounting of Amazon EFS file systems to EC2 instances directly from […]

Read More

Automating Amazon EBS Volume-resizing with AWS Step Functions and AWS Systems Manager

In active applications, it’s possible for an Amazon EC2 instance’s Amazon EBS volume utilization to reach provisioned capacity. Depending on the application in use, this creates the risk of a customer-impacting application outage when that provisioned capacity is exhausted. One solution is to design a failover mechanism into the application. However, this can be a […]

Read More

Maximizing Microsoft SQL Server Performance with Amazon EBS

AWS customers have been running mission-critical Windows workloads, like SQL Server, on AWS for more than 10 years. In this post, I discuss how to maximize SQL Server performance with Amazon EBS storage. Persistent block storage is a critical component of a relational database management system (RDBMS) and is ultimately responsible for the speed, security, […]

Read More

Using AWS SFTP Logical Directories to Build a Simple Data Distribution Service

We launched the AWS Transfer for SFTP (AWS SFTP) service in November of 2018, and it has since been adopted by many organizations to enable secure SFTP access to data hosted in Amazon S3. At AWS, we are continuously iterating on our services, and many of our customers have told us that they would like […]

Read More

Best Practices for Using Amazon EFS for Container Storage

Tens of thousands of companies are storing petabytes of data on Amazon Elastic File System (Amazon EFS), many of them using EFS to store data for containerized applications. Amazon EFS file systems can be attached to containers launched by both Amazon Elastic Container Service (ECS) and Elastic Kubernetes Service (EKS). Amazon EFS is a natural […]

Read More
S3 Batch Operations

Transcoding video files with S3 Batch Operations

The ability to work quickly in bulk—to work smarter rather than harder—is vital for the practical storage management of modern video archives, which can easily be petabytes of data. S3 Batch Operations is an Amazon S3 feature that can perform actions like copying or tagging objects across millions or billions of objects with a single […]

Read More

Building an HPC cluster with AWS ParallelCluster and Amazon FSx for Lustre

High performance computing (HPC) customers love the breadth of services offered by AWS and the flexibility offered by the cloud to address their computational challenges. AWS provides you with the opportunity to innovate quickly and accelerate your workflow thanks to a virtually unlimited capacity. For more information, see the following posts: Natural language processing at Clemson […]

Read More

Using Okta as an identity provider with AWS Transfer for SFTP

AWS Transfer for SFTP (AWS SFTP) is a fully managed service that enables you to move file transfer workloads to AWS when they use the Secure Shell File Transfer Protocol (SFTP). Enterprises and startups across a range of industries can use AWS SFTP without needing to modify applications or manage any SFTP servers. Data uploaded […]

Read More

New on the Open Source blog: Using the FSx for Lustre CSI Driver with Amazon EKS

From time to time the AWS Storage Blog will point you to storage related blog posts from other AWS blog channels that we think you will find interesting or helpful for your storage use cases. We wanted to share a post from the Open Source Blog that highlights a walk-through of using Amazon FSx for Lustre […]

Read More