AWS Storage Blog
Category: Amazon Elastic File System (EFS)
AWS file storage at re:Invent 2023 in 3 easy steps
AWS re:Invent 2023 is happening November 27th through December 1st in Las Vegas Nevada. AWS re:Invent offers cloud enthusiasts, experts, and practitioners an experience like no other. You get five days of opportunities to find productive solutions that will transform your company and your pick of 2,000+ learning sessions to quickly master new skills. And, […]
How to monitor Amazon Elastic File System (EFS) storage costs
Every organization should be seeking to optimize resource utilization, aiming for the highest efficacy at the lowest possible cost. To make effective data-driven cost optimization decisions, it’s essential to have relevant data, tools for generating reports, and clear documentation on how to do so. Amazon Elastic File System (Amazon EFS) offers serverless, scalable, and fully […]
Transferring data from Google Cloud Filestore to Amazon EFS using AWS DataSync
Organizations may need to transfer large numbers of files from one cloud provider to another for a variety of reasons like workload migration, disaster recovery, or a requirement to process data in other clouds. Data transfers typically require end-to-end encryption, the ability to detect changes, object validation, network throttling, monitoring, and cost optimization. Building a […]
Authorize NFS clients outside of AWS with AWS IAM Roles Anywhere
Securely storing and authorizing access to data in the cloud is a top priority. One challenge faced by organizations is developing a consistent authorization experience to grant access to data for hybrid architectures. Workloads running on AWS can access data stored on services like Amazon Elastic File System (Amazon EFS) using AWS Identity and Access […]
How to accelerate your data transfers with AWS DataSync scale out architectures
Do you ever wonder how you can keep up with incoming requests for increased storage capacity without having to expand data center footprint, increase utility spend, and continually handle hardware refresh cycles? Customers are looking to free up space from on-premises storage systems or other clouds, whether it is for existing archival datasets, transitioning their […]
Performance analysis for different Amazon EFS throughput modes via Amazon CloudWatch
When I talk with customers about their file storage, I frequently get asked “How can I determine the right throughput capacity for my file storage?” The simple answer is through monitoring the performance of your workload to determine the right performance configuration for your file storage. Throughput modes for Amazon Elastic File System (EFS) determine […]
Use cases for Amazon EFS Replication
Organizations in regulated industries are frequently required to maintain a copy of their business-critical file data in another location to meet corporate compliance or disaster recovery (DR) mandates. Furthermore, in highly distributed environments, applications need a reliable method to move or copy their file data to a different location for low latency access or to […]
Machine Learning with Kubeflow on Amazon EKS with Amazon EFS
Training Machine Learning models involves multiple steps, it gets more complex and time consuming when the size of the data set for training is in the range of 100s of GBs. Data Scientists run through large number of experiments and research which includes testing and training large number of models. Kubeflow provides various ML capabilities […]
Persistent storage for Kubernetes
Stateful applications rely on data being persisted and retrieved to run properly. When running stateful applications using Kubernetes, state needs to be persisted regardless of container, pod, or node crashes or terminations. This requires persistent storage, that is, storage that lives beyond the lifetime of the container, pod, or node. In this blog, we cover […]
What’s in store with AWS Storage at re:Invent 2022
On behalf of the entire AWS Storage team, I am excited to welcome you to our 11th annual event, whether you’ll attend in person or virtually. AWS re:Invent 2022 is here, featuring an exciting slate of sessions on AWS Storage use cases, best practices, and technical deep dives. On-site in Vegas? Attend the AWS Storage […]