The AWS Storage Gateway service helps customers seamlessly integrate existing on-premises storage infrastructure and data with the AWS Cloud. It uses industry-standard storage protocols to connect existing storage applications and workflows to AWS cloud storage services for minimal process disruption.
It maintains frequently accessed data on-premises to provide low-latency performance while securely and durably storing data in Amazon S3, Amazon EBS, or Amazon Glacier cloud storage. It also includes a highly optimized data transfer mechanism, with bandwidth management, automated network resilience, and efficient data transfers.
Storage Gateway also integrates your data with AWS encryption, identity management, monitoring, and storage services to combine the security, durability, and scalability of the AWS Cloud with existing storage environments.
Customers commonly use hybrid cloud storage for use cases such as:
Hybrid cloud workloads. Big data, cloud bursting or cloud data migration architectures may need local capacity and performance with a connection to a central storage repository in the cloud. Storage Gateway streamlines moving data between your organization and AWS to manage workloads in the cloud.
Backup, archive, and disaster recovery. Storage Gateway is a drop-in replacement for tape and tape automation, and integrates with leading industry backup software packages. Storage Gateway can take snapshots of your local volumes which can restored as Amazon EBS volumes in the event of a local site disaster.
Tiered Storage. Some customers design storage architectures that preserve or extend high performance on-premises investments by adding a lower cost, on-demand cloud tier. This is ideal for archival or cost-reduction projects.
The file interface enables you to store and retrieve objects in Amazon S3 using industry-standard file protocols. Files are stored as objects in your S3 buckets, accessed through a Network File System (NFS) mount point. Ownership, permissions, and timestamps are durably stored in S3 in the user-metadata of the object associated with the file. Once objects are transferred to S3, they can be managed as native S3 objects, and bucket policies such as versioning, lifecycle management, and cross-region replication apply directly to objects stored in your bucket.
Customers use the file interface to migrate file data into S3 for use by object-based workloads, as a cost-effective storage target for traditional backup applications, and as a tier in the cloud for on-premises file storage.
The volume interface presents your applications with disk volumes using the iSCSI block protocol. Data written to these volumes can be asynchronously backed up as point-in-time snapshots of your volumes, and stored in the cloud as Amazon EBS snapshots. You can set the schedule for when snapshots occur or create them via the AWS Management Console or service API. Snapshots are incremental backups that capture only changed blocks. All snapshot storage is also compressed to minimize your storage charges.
When connecting with the block interface, you can run the gateway in two modes: cached and stored. In cached mode, you store your primary data in Amazon S3 and retain your frequently accessed data locally. With this mode, you can achieve substantial cost savings on primary storage, minimizing the need to scale your storage on-premises, while retaining low-latency access to your frequently accessed data.
In stored mode, you store your entire data set locally, while performing asynchronous backups of this data in Amazon S3. This mode provides durable and inexpensive offsite backups that you can recover locally or from Amazon EC2.
Customers often choose the volume gateway to backup and archive local disks, and to build disaster recovery solutions based on snapshots.
The tape interface presents the Storage Gateway to your existing backup application as an industry-standard iSCSI-based virtual tape library (VTL), consisting of a virtual media changer and virtual tape drives. You can continue to use your existing backup applications and workflows while writing to a nearly limitless collection of virtual tapes. Each virtual tape is stored in Amazon S3. When you no longer require immediate or frequent access to data contained on a virtual tape, you can have your backup application archive it from the virtual tape lLibrary into Amazon Glacier, further reducing storage costs.
Storage Gateway is currently compatible with most leading backup applications. The VTL interface eliminates large upfront tape automation capital expenses, multi-year maintenance contract commitments and ongoing media costs. You pay only for the capacity you use and scale as your needs grow. The need to transport storage media to offsite facilities and handle tape media manually goes away, and your archives benefit from the design and durability of the AWS cloud platform.
Storage Gateway gives you the performance of local disk with the scale and durability of the AWS Cloud. It intelligently manages the movement of your data into and out of your cloud storage platforms, automatically buffering and throttling bandwidth based on the behavior you require. You can set it up to maximize local performance and use the cloud as a secondary tier, use the cloud as primary storage with the gateway as a local cache, or mix local disk storage with cloud storage to balance your network traffic and your local performance. Optimizations such as multipart management, delta transfers, bandwidth throttling, and bandwidth scheduling are standard for all interfaces.