AWS Storage Blog

Tag: Amazon FSx for Lustre

Automate file retrieval from S3 Glacier when using FSx for Lustre

Customers are running modern high performance computing (HPC) workloads on AWS to process large datasets cost-effectively and optimize performance. These workloads typically rely on a high-performance file system to provide low latency and high throughput access to the data. A performant file system is important so that the file storage can keep up with the […]

Spend less while increasing performance with Amazon FSx for Lustre data compression

Many customers associate a performance cost with data compression, but that’s not the case with Amazon FSx for Lustre. With FSx for Lustre, data compression reduces storage costs and increases aggregate file system throughput. As organizations continue to build applications faster than ever, the amount of data that organizations must store grows rapidly. Organizations need […]

AWS Backup 2021 blog image

Cross-Region and cross-account backups for Amazon FSx using AWS Backup

Today, AWS Backup is announcing cross-Region and cross-account backup (CRAB) support for Amazon FSx. AWS Backup offers a cost-effective, fully managed, policy-based service that further simplifies data protection at scale. AWS Backup also helps you support your regulatory compliance obligations and meets your business continuity goals. Amazon FSx makes it easy and cost-effective to run […]

Customer innovation during the COVID-19 pandemic

To call 2020 a challenging year would be a considerable understatement. The prolonged period of the pandemic has made a significant impact on our daily lives, creating a “new normal.” What used to be normal, connecting face-to-face to conduct business and socialize with friends and family, has turned even more digital. This was inevitable and […]

re:Invent

AWS re:Invent recap: Deep dive on Amazon FSx for Lustre + Amazon S3

Amazon S3 stores exabytes of data, trillions of objects, and peaks regularly at millions of requests per second. It has set the standard for object storage across the globe. If you’re reading this blog, you probably have data stored in Amazon S3. This could be financial services, life sciences, or media and entertainment data. Perhaps […]

Amazon FSx at re:Invent 2020-2021: Move to fully managed file storage on AWS

Managing shared storage for file-based workloads on-premises is often complex, difficult to scale, and costly. At re:Invent 2018, we launched Amazon FSx, which makes it easy and cost effective to launch and scale popular file systems that are fully managed by AWS. Amazon FSx for Windows File Server is the first and only fully managed […]

Add storage to your high-performance file system with a single click

Many organizations have on-premises, high-performance workloads burdened with complex management and scalability challenges. Scaling data-intensive workloads on-premises typically involves purchasing more hardware, which can slow time to production and require high upfront investment. The agility to scale compute and storage resources to meet business needs is one of the reasons why our customers choose to […]

AWS Backup provides centralized data protection across your AWS resources

Today, on AWS Storage Day 2020, we are excited to announce AWS Backup supports backups of Amazon FSx file systems and Windows workloads running on EC2, adding to the growing list of features to enhance your data protection. Amazon FSx customers may now enjoy the automation, ease-of-use, and managed compliance protection service that AWS Backup […]

Optimize price and performance with Amazon FSx for Lustre

Earlier this year, I blogged about the performance characteristics of Amazon FSx for Lustre persistent file systems. As with everything AWS, we never rest on our laurels and we continue to push the envelope and drive innovation. Recently, we launched a new lower-cost Hard Disk Drive (HDD) storage type for Amazon FSx for Lustre Persistent […]

How Qubole optimizes cost and performance by managing shuffle data

Ad hoc analytics, data exploration, data engineering, and machine learning (ML) workloads are often run at a massive scale and require significant computing power, which can be costly. Amazon EC2 Spot Instances, which enable you to use unused Amazon EC2 computing capacity in the AWS Cloud, offer up to 90% in savings over On-Demand Instances. […]