AWS Storage Blog
Tag: Amazon Elastic File System (Amazon EFS)
Performance analysis for different Amazon EFS throughput modes via Amazon CloudWatch
When I talk with customers about their file storage, I frequently get asked “How can I determine the right throughput capacity for my file storage?” The simple answer is through monitoring the performance of your workload to determine the right performance configuration for your file storage. Throughput modes for Amazon Elastic File System (EFS) determine […]
Machine Learning with Kubeflow on Amazon EKS with Amazon EFS
Training Machine Learning models involves multiple steps, it gets more complex and time consuming when the size of the data set for training is in the range of 100s of GBs. Data Scientists run through large number of experiments and research which includes testing and training large number of models. Kubeflow provides various ML capabilities […]
Persistent storage for Kubernetes
Stateful applications rely on data being persisted and retrieved to run properly. When running stateful applications using Kubernetes, state needs to be persisted regardless of container, pod, or node crashes or terminations. This requires persistent storage, that is, storage that lives beyond the lifetime of the container, pod, or node. In this blog, we cover […]
Using available Amazon EFS security features while migrating files with AWS DataSync
When performing an online data migration, an important requirement is often security in transit. When evaluating migration options, you should consider if the tools available can provide encryption of data in flight, to help prevent unauthorized users from reading your data. Amazon Elastic File System (EFS) provides the ability to encrypt data in transit by […]
Simplify and accelerate your data migration using AWS DataSync Discovery
UPDATE (7/22/2025): On May 20, 2025 AWS DataSync Discovery reached its end of support date, and can no longer be accessed. See the AWS Product Lifecycle page or the AWS service changes page for more details. Migrating your on-premises data to the cloud can be intimidating at first, particularly when you are working with large […]
Accelerate SAP workload migrations with AWS Transfer Family
Companies operate applications in their corporate IT landscape that rely on transfer protocols, such as Secure Shell (SSH) File Transfer Protocol (SFTP), File Transfer Protocol Secure (FTPS), and File Transfer Protocol (FTP). Historically, FTP has been used to share files such as invoices, inventory lists and delivery notes that are created by SAP systems, which […]
Transferring files securely at the Foxtel Group using AWS Transfer Family and Amazon EFS
The Foxtel Group is Australia’s leading, next-generation subscription television company providing movies, entertainment, lifestyle, documentaries, news, and live sports through a range of streaming and broadcast services to over four million subscribers. Enterprises such as the Foxtel Group rely upon secure file transfer solutions for the timely and secure transfer of data between themselves and […]
Analytical processing of millions of cell images using Amazon EFS and Amazon S3
Analytical workloads such as batch processing, high performance computing, or machine learning inference often have high IOPS and low latency requirements but operate at irregular intervals on subsets of large datasets. Typically, data is manually copied between storage tiers in preparation of processing, which can be cumbersome and error-prone. Given this, IT teams want to […]
How SkyWatch built its satellite imagery solution using AWS Lambda and Amazon EFS
SkyWatch is on a mission to democratize remote sensing data through a simple user experience. Every day, trillions of pixels of Earth observation imagery are captured by satellites orbiting our planet. New applications for this data are developed every week, with demand increasing across many industries. Examples include commercial applications, such as construction, finance, and […]
A gene-editing prediction engine with iterative learning cycles built on AWS
NRGene develops cutting-edge genomic analytics products that are reshaping agriculture worldwide. Among our customers are some of the biggest and most sophisticated companies in seed-development, food and beverages, paper, rubber, cannabis, and more. In the middle of 2020, NRGene joined a consortium of companies and academic institutions to build the best-in-class gene-editing prediction platform to […]