AWS Storage Blog

Category: Compute

Machine Learning with Kubeflow on Amazon EKS with Amazon EFS

Training Machine Learning models involves multiple steps, it gets more complex and time consuming when the size of the data set for training is in the range of 100s of GBs. Data Scientists run through large number of experiments and research which includes testing and training large number of models. Kubeflow provides various ML capabilities […]

Persistent storage for Kubernetes 

Stateful applications rely on data being persisted and retrieved to run properly. When running stateful applications using Kubernetes, state needs to be persisted regardless of container, pod, or node crashes or terminations. This requires persistent storage, that is, storage that lives beyond the lifetime of the container, pod, or node. In this blog, we cover […]

Amazon EBS at re:Invent 2022: Protect data at rest, in transit, and in volume backups

Mission critical workloads need advanced data services for data protection. Amazon Elastic Block Store (EBS) not only provides high-performance block-level storage volumes for Amazon Elastic Compute Cloud (EC2) instances, but also offers comprehensive and consistent data protection capabilities designed to protect data on block storage. Customers have been using Amazon EBS for over a decade […]

AWS Elastic Disaster Recovery

Automating disaster recovery of Amazon RDS and Amazon EC2 instances

Complex environments can sometimes feel like they require complex disaster recovery (DR) solutions, which usually consist of multiple DR offerings from different vendors that may not interact with each other. There are many ways to build a DR solution in the cloud. Luckily, with AWS, you can easily configure multiple DR services and orchestrate them […]

Amazon EBS at re:Invent 2022: Balancing costs and getting the most out of your block storage

When I talk with customers, one of the most popular questions that I get asked is “What are the easiest ways I can get more out of what I’m provisioning on AWS?” In my role, I’m focused on Amazon Elastic Block Store (EBS), the storage powering Amazon Elastic Compute Cloud (EC2) and many managed services. […]

File storage access patterns insights using Amazon FSx for Windows File Server

When using Windows file services, enterprise customers often have the requirement to identify potential security breaches and unauthorized access attempts. Traditionally, customers rely on Windows file server file access auditing to capture and analyze audit records to gain these insights and strengthen their security posture. Amazon FSx for Windows File Server provides fully managed shared […]

Amazon EBS at re:Invent 2022: Build data resiliency and highly available architectures

Amazon Elastic Block Store (EBS) is a foundational service for almost anything customers do in AWS. It’s always a good idea to revisit your architecture to make sure it is scaling in a resilient way as you grow in AWS. With this in mind, we have several re:Invent sessions planned this year with a focus on […]

AWS Transfer Family Featured Image

Enable session limits for AWS Transfer Family

Enterprises and organizations proficient in file transfers exchange a wide variety of files, such as digital media contents, images, or large data sets with their business partners or public users. When a large shared dataset is being downloaded by end users, a file transfer server often has a limit on concurrent connection per user to […]

AWS Elastic Disaster Recovery

Managing AWS Elastic Disaster Recovery launch templates at scale

It’s important to have a disaster recovery (DR) plan in place that helps operations continue in the event of a natural, physical, or technology-based disaster. To increase the chances of success in the case of an outage event, recovery should be repeatable, scalable, and tested often. Without the proper tools in place, setting up such […]

Automatically archive Amazon EBS Snapshots with Amazon Data Lifecycle Manager

Customers use snapshots to capture a point-in-time copy of their data, which can be used to enable disaster recovery, migrate data across regions and accounts, and improve backup compliance. For enterprises using snapshots, it is a common requirement to keep snapshots (which are seldom accessed) for more than 90 days, for compliance purposes. However, the […]