Host Instance Storage Volumes Table
A table listing the storage volumes for host instance types.
Release Date: June 24, 2020
Created On: June 24, 2020
Last Updated: October 27, 2022
The following table shows the size of the storage volume that Amazon SageMaker attaches for each instance type for a single endpoint and for a multi-model endpoint. For a MultiModel-enabled container, the storage volume provisioned for its instances has more memory. This allows more models to be cached on the instance storage volume.
Because d instance types come with an NVMe SSD storage, Amazon SageMaker doesn't attach an Amazon EBS storage volume to these ML compute instances that host the multi-model endpoint.
Instance Type | Storage Volume in GB | Storage Volume for Multi-Model Endpoint in GB |
---|---|---|
ml.t2.medium | 2 | 8 |
ml.t2.large | 4 | 16 |
ml.t2.xlarge | 8 | 32 |
ml.t2.2xlarge | 16 | 64 |
ml.m4.xlarge | 8 | 32 |
ml.m4.2xlarge | 16 | 64 |
ml.m4.4xlarge | 30 | 128 |
ml.m4.10xlarge | 30 | 320 |
ml.m4.16xlarge | 30 | 512 |
ml.m5.large | 4 | 16 |
ml.m5.xlarge | 8 | 32 |
ml.m5.2xlarge | 16 | 64 |
ml.m5.4xlarge | 30 | 128 |
ml.m5.12xlarge | 30 | 384 |
ml.m5.24xlarge | 30 | 768 |
ml.c4.large | 4 | 7.5 |
ml.c4.xlarge | 4 | 15 |
ml.c4.2xlarge | 8 | 30 |
ml.c4.4xlarge | 15 | 60 |
ml.c4.8xlarge | 30 | 120 |
ml.c5.large | 2 | 8 |
ml.c5.xlarge | 4 | 16 |
ml.c5.2xlarge | 8 | 32 |
ml.c5.4xlarge | 16 | 72 |
ml.c5.9xlarge | 30 | 144 |
ml.c5.18xlarge | 30 | 288 |
ml.c6i.large | 2 | 8 |
ml.c6i.xlarge | 4 | 16 |
ml.c6i.2xlarge | 8 | 32 |
ml.c6i.4xlarge | 16 | 64 |
ml.c6i.8xlarge | 30 | 128 |
ml.c6i.12xlarge | 30 | 192 |
ml.c6i.16xlarge | 30 | 256 |
ml.c6i.24xlarge | 30 | 384 |
ml.c6i.32xlarge | 30 | 512 |
ml.p2.xlarge | 30 | 122 |
ml.p2.8xlarge | 30 | Not supported |
ml.p2.16xlarge | 30 | Not supported |
ml.p3.2xlarge | 30 | 122 |
ml.p3.8xlarge | 30 | Not supported |
ml.p3.16xlarge | 30 | Not supported |
inf1.xlarge | 4 | Not supported |
inf1.2xlarge | 8 | Not supported |
inf1.6xlarge | 24 | Not supported |
inf1.24xlarge | 30 | Not supported |
ml.r5.large | 8 | 32 |
ml.r5.xlarge | 16 | 64 |
ml.r5.2xlarge | 30 | 128 |
ml.r5.4xlarge | 30 | 256 |
ml.r5.12xlarge | 30 | 762 |
ml.r5.24xlarge | 30 | 1536 |
ml.m5d.large | 1 x 75 GB (NVMe SSD) | 1 x 75 GB (NVMe SSD) |
ml.m5d.xlarge | 1 x 150 GB (NVMe SSD) | 1 x 150 GB (NVMe SSD) |
ml.m5d.2xlarge | 1 x 300 GB (NVMe SSD) | 1 x 300 GB (NVMe SSD) |
ml.m5d.4xlarge | 2 x 300 GB (600 GB) (NVMe SSD) | 2 x 300 GB (600 GB) (NVMe SSD) |
ml.m5d.12xlarge | 2 x 900 GB (1.8 TB) (NVMe SSD) | 2 x 900 GB (1.8 TB) (NVMe SSD) |
ml.m5d.24xlarge | 4 x 900 GB (3.6 TB) (NVMe SSD) | 4 x 900 GB (3.6 TB) (NVMe SSD) |
ml.c5d.large | 1 x 50 GB (NVMe SSD) | 1 x 50 GB (NVMe SSD) |
ml.c5d.xlarge | 1 x 100 GB (NVMe SSD) | 1 x 100 GB (NVMe SSD) |
ml.c5d.2xlarge | 1 x 200 GB (NVMe SSD) | 1 x 200 GB (NVMe SSD) |
ml.c5d.4xlarge | 1 x 400 GB (NVMe SSD) | 1 x 400 GB (NVMe SSD) |
mk.c5d.9xlarge | 1 x 900 GB (NVMe SSD) | 1 x 900 GB (NVMe SSD) |
ml.c5d.18xlarge | 2 x 900 GB (1.8 TB) (NVMe SSD) | 2 x 900 GB (1.8 TB) (NVMe SSD) |
ml.r5d.large | 1 x 75 GB (NVMe SSD) | 1 x 75 GB (NVMe SSD) |
ml.r5d.xlarge | 1 x 150 GB (NVMe SSD) | 1 x 150 GB (NVMe SSD) |
ml.r5d.2xlarge | 1 x 300 GB (NVMe SSD) | 1 x 300 GB (NVMe SSD) |
ml.r5d.4xlarge | 2 x 300 GB (600 GB) (NVMe SSD) | 2 x 300 GB (600 GB) (NVMe SSD) |
ml.r5d.12xlarge | 2 x 900 GB (1.8 TB) (NVMe SSD) | 2 x 900 GB (1.8 TB) (NVMe SSD) |
ml.r5d.24xlarge | 4 x 900 GB (3.6 TB) (NVMe SSD) | 4 x 900 GB (3.6 TB) (NVMe SSD) |
ml.g5.xlarge | 1 x 250 GB (NVMe SSD) | 1 x 250 GB (NVMe SSD) |
ml.g5.2xlarge | 1 x 450 GB (NVMe SSD) | 1 x 450 GB (NVMe SSD) |
ml.g5.4xlarge | 1 x 600 GB (NVMe SSD) | 1 x 600 GB (NVMe SSD) |
ml.g5.8xlarge | 1 x 900 GB (NVMe SSD) | 1 x 900 GB (NVMe SSD) |
ml.g5.12xlarge | 1 x 3800 GB (NVMe SSD) | Not supported |
ml.g5.16xlarge | 1 x 1900 GB (NVMe SSD) | 1 x 1900 GB (NVMe SSD) |
ml.g5.24xlarge | 1 x 3800 GB (NVMe SSD) | Not supported |
ml.g5.48xlarge | 1 x 7600 GB (NVMe SSD) | Not supported |
ml.g4dn.xlarge | 1 x 125 GB (NVMe SSD) | 1 x 125 GB (NVMe SSD) |
ml.g4dn.2xlarge | 1 x 225 GB (NVMe SSD) | 1 x 225 GB (NVMe SSD) |
ml.g4dn.4xlarge | 1 x 225 GB(NVMe SSD) | 1 x 225 GB (NVMe SSD) |
ml.g4dn.8xlarge | 1 x 900 GB (NVMe SSD) | 1 x 900 GB (NVMe SSD) |
ml.g4dn.12xlarge | 1 x 900 GB (NVMe SSD) | Not supported |
ml.g4dn.16xlarge | 1 x 900 GB (NVMe SSD) | 1 x 900 GB (NVMe SSD) |
ml.c7g.large | 2 | Not supported |
ml.c7g.xlarge | 4 | Not supported |
ml.c7g.2xlarge | 8 | Not supported |
ml.c7g.4xlarge | 16 | Not supported |
ml.c7g.8xlarge | 30 | Not supported |
ml.c7g.12xlarge | 30 | Not supported |
ml.c7g.16xlarge | 30 | Not supported |
ml.m6g.large | 4 | Not supported |
ml.m6g.xlarge | 8 | Not supported |
ml.m6g.2xlarge | 16 | Not supported |
ml.m6g.4xlarge | 30 | Not supported |
ml.m6g.8xlarge | 30 | Not supported |
ml.m6g.12xlarge | 30 | Not supported |
ml.m6g.16xlarge | 30 | Not supported |
ml.m6gd.large | 4 | Not supported |
ml.m6gd.xlarge | 8 | Not supported |
ml.m6gd.2xlarge | 16 | Not supported |
ml.m6gd.4xlarge | 30 | Not supported |
ml.m6gd.8xlarge | 30 | Not supported |
ml.m6gd.12xlarge | 30 | Not supported |
ml.m6gd.16xlarge | 30 | Not supported |
ml.c6g.large | 2 | Not supported |
ml.c6g.xlarge | 4 | Not supported |
ml.c6g.2xlarge | 8 | Not supported |
ml.c6g.4xlarge | 16 | Not supported |
ml.c6g.8xlarge | 30 | Not supported |
ml.c6g.12xlarge | 30 | Not supported |
ml.c6g.16xlarge | 30 | Not supported |
ml.c6gd.large | 2 | Not supported |
ml.c6gd.xlarge | 4 | Not supported |
ml.c6gd.2xlarge | 8 | Not supported |
ml.c6gd.4xlarge | 16 | Not supported |
ml.c6gd.8xlarge | 30 | Not supported |
ml.c6gd.12xlarge | 30 | Not supported |
ml.c6gd.16xlarge | 30 | Not supported |
ml.c6gn.large | 2 | Not supported |
ml.c6gn.xlarge | 4 | Not supported |
ml.c6gn.2xlarge | 8 | Not supported |
ml.c6gn.4xlarge | 16 | Not supported |
ml.c6gn.8xlarge | 30 | Not supported |
ml.c6gn.12xlarge | 30 | Not supported |
ml.c6gn.16xlarge | 30 | Not supported |
ml.r6g.large | 8 | Not supported |
ml.r6g.xlarge | 16 | Not supported |
ml.r6g.2xlarge | 30 | Not supported |
ml.r6g.4xlarge | 30 | Not supported |
ml.r6g.8xlarge | 30 | Not supported |
ml.r6g.12xlarge | 30 | Not supported |
ml.r6g.16xlarge | 30 | Not supported |
ml.r6gd.large | 8 | Not supported |
ml.r6gd.xlarge | 16 | Not supported |
ml.r6gd.2xlarge | 30 | Not supported |
ml.r6gd.4xlarge | 30 | Not supported |
ml.r6gd.8xlarge | 30 | Not supported |
ml.r6gd.12xlarge | 30 | Not supported |
ml.r6gd.16xlarge | 30 | Not supported |
Serverless | 5 | Not supported |