Host Instance Storage Volumes Table

A table listing the storage volumes for host instance types.


Release Date: June 24, 2020
Created On: June 24, 2020
Last Updated: October 27, 2022


The following table shows the size of the storage volume that Amazon SageMaker attaches for each instance type for a single endpoint and for a multi-model endpoint. For a MultiModel-enabled container, the storage volume provisioned for its instances has more memory. This allows more models to be cached on the instance storage volume.

Because d instance types come with an NVMe SSD storage, Amazon SageMaker doesn't attach an Amazon EBS storage volume to these ML compute instances that host the multi-model endpoint.

Instance Type Storage Volume in GB Storage Volume for Multi-Model Endpoint in GB
ml.t2.medium 2 8
ml.t2.large 4 16
ml.t2.xlarge 8 32
ml.t2.2xlarge 16 64
ml.m4.xlarge 8 32
ml.m4.2xlarge 16 64
ml.m4.4xlarge 30 128
ml.m4.10xlarge 30 320
ml.m4.16xlarge 30 512
ml.m5.large 4 16
ml.m5.xlarge 8 32
ml.m5.2xlarge 16 64
ml.m5.4xlarge 30 128
ml.m5.12xlarge 30 384
ml.m5.24xlarge 30 768
ml.c4.large 4 7.5
ml.c4.xlarge 4 15
ml.c4.2xlarge 8 30
ml.c4.4xlarge 15 60
ml.c4.8xlarge 30 120
ml.c5.large 2 8
ml.c5.xlarge 4 16
ml.c5.2xlarge 8 32
ml.c5.4xlarge 16 72
ml.c5.9xlarge 30 144
ml.c5.18xlarge 30 288
ml.c6i.large 2 8
ml.c6i.xlarge 4 16
ml.c6i.2xlarge 8 32
ml.c6i.4xlarge 16 64
ml.c6i.8xlarge 30 128
ml.c6i.12xlarge 30 192
ml.c6i.16xlarge 30 256
ml.c6i.24xlarge 30 384
ml.c6i.32xlarge 30 512
ml.p2.xlarge 30 122
ml.p2.8xlarge 30 Not supported
ml.p2.16xlarge 30 Not supported
ml.p3.2xlarge 30 122
ml.p3.8xlarge 30 Not supported
ml.p3.16xlarge 30 Not supported
inf1.xlarge 4 Not supported
inf1.2xlarge 8 Not supported
inf1.6xlarge 24 Not supported
inf1.24xlarge 30 Not supported
ml.r5.large 8 32
ml.r5.xlarge 16 64
ml.r5.2xlarge 30 128
ml.r5.4xlarge 30 256
ml.r5.12xlarge 30 762
ml.r5.24xlarge 30 1536
ml.m5d.large 1 x 75 GB (NVMe SSD) 1 x 75 GB (NVMe SSD)
ml.m5d.xlarge 1 x 150 GB (NVMe SSD) 1 x 150 GB (NVMe SSD)
ml.m5d.2xlarge 1 x 300 GB (NVMe SSD) 1 x 300 GB (NVMe SSD)
ml.m5d.4xlarge 2 x 300 GB (600 GB) (NVMe SSD) 2 x 300 GB (600 GB) (NVMe SSD)
ml.m5d.12xlarge 2 x 900 GB (1.8 TB) (NVMe SSD) 2 x 900 GB (1.8 TB) (NVMe SSD)
ml.m5d.24xlarge 4 x 900 GB (3.6 TB) (NVMe SSD) 4 x 900 GB (3.6 TB) (NVMe SSD)
ml.c5d.large 1 x 50 GB (NVMe SSD) 1 x 50 GB (NVMe SSD)
ml.c5d.xlarge 1 x 100 GB (NVMe SSD) 1 x 100 GB (NVMe SSD)
ml.c5d.2xlarge 1 x 200 GB (NVMe SSD) 1 x 200 GB (NVMe SSD)
ml.c5d.4xlarge 1 x 400 GB (NVMe SSD) 1 x 400 GB (NVMe SSD)
mk.c5d.9xlarge 1 x 900 GB (NVMe SSD) 1 x 900 GB (NVMe SSD)
ml.c5d.18xlarge 2 x 900 GB (1.8 TB) (NVMe SSD) 2 x 900 GB (1.8 TB) (NVMe SSD)
ml.r5d.large 1 x 75 GB (NVMe SSD) 1 x 75 GB (NVMe SSD)
ml.r5d.xlarge 1 x 150 GB (NVMe SSD) 1 x 150 GB (NVMe SSD)
ml.r5d.2xlarge 1 x 300 GB (NVMe SSD) 1 x 300 GB (NVMe SSD)
ml.r5d.4xlarge 2 x 300 GB (600 GB) (NVMe SSD) 2 x 300 GB (600 GB) (NVMe SSD)
ml.r5d.12xlarge 2 x 900 GB (1.8 TB) (NVMe SSD) 2 x 900 GB (1.8 TB) (NVMe SSD)
ml.r5d.24xlarge 4 x 900 GB (3.6 TB) (NVMe SSD) 4 x 900 GB (3.6 TB) (NVMe SSD)
ml.g5.xlarge 1 x 250 GB (NVMe SSD) 1 x 250 GB (NVMe SSD)
ml.g5.2xlarge 1 x 450 GB (NVMe SSD) 1 x 450 GB (NVMe SSD)
ml.g5.4xlarge 1 x 600 GB (NVMe SSD) 1 x 600 GB (NVMe SSD)
ml.g5.8xlarge 1 x 900 GB (NVMe SSD) 1 x 900 GB (NVMe SSD)
ml.g5.12xlarge 1 x 3800 GB (NVMe SSD) Not supported
ml.g5.16xlarge 1 x 1900 GB (NVMe SSD) 1 x 1900 GB (NVMe SSD)
ml.g5.24xlarge 1 x 3800 GB (NVMe SSD) Not supported
ml.g5.48xlarge 1 x 7600 GB (NVMe SSD) Not supported
ml.g4dn.xlarge 1 x 125 GB (NVMe SSD) 1 x 125 GB (NVMe SSD)
ml.g4dn.2xlarge 1 x 225 GB (NVMe SSD) 1 x 225 GB (NVMe SSD)
ml.g4dn.4xlarge 1 x 225 GB(NVMe SSD) 1 x 225 GB (NVMe SSD)
ml.g4dn.8xlarge 1 x 900 GB (NVMe SSD) 1 x 900 GB (NVMe SSD)
ml.g4dn.12xlarge 1 x 900 GB (NVMe SSD) Not supported
ml.g4dn.16xlarge 1 x 900 GB (NVMe SSD) 1 x 900 GB (NVMe SSD)
ml.c7g.large 2 Not supported
ml.c7g.xlarge 4 Not supported
ml.c7g.2xlarge 8 Not supported
ml.c7g.4xlarge 16 Not supported
ml.c7g.8xlarge 30 Not supported
ml.c7g.12xlarge 30 Not supported
ml.c7g.16xlarge 30 Not supported
ml.m6g.large 4 Not supported
ml.m6g.xlarge 8 Not supported
ml.m6g.2xlarge 16 Not supported
ml.m6g.4xlarge 30 Not supported
ml.m6g.8xlarge 30 Not supported
ml.m6g.12xlarge 30 Not supported
ml.m6g.16xlarge 30 Not supported
ml.m6gd.large 4 Not supported
ml.m6gd.xlarge 8 Not supported
ml.m6gd.2xlarge 16 Not supported
ml.m6gd.4xlarge 30 Not supported
ml.m6gd.8xlarge 30 Not supported
ml.m6gd.12xlarge 30 Not supported
ml.m6gd.16xlarge 30 Not supported
ml.c6g.large 2 Not supported
ml.c6g.xlarge 4 Not supported
ml.c6g.2xlarge 8 Not supported
ml.c6g.4xlarge 16 Not supported
ml.c6g.8xlarge 30 Not supported
ml.c6g.12xlarge 30 Not supported
ml.c6g.16xlarge 30 Not supported
ml.c6gd.large 2 Not supported
ml.c6gd.xlarge 4 Not supported
ml.c6gd.2xlarge 8 Not supported
ml.c6gd.4xlarge 16 Not supported
ml.c6gd.8xlarge 30 Not supported
ml.c6gd.12xlarge 30 Not supported
ml.c6gd.16xlarge 30 Not supported
ml.c6gn.large 2 Not supported
ml.c6gn.xlarge 4 Not supported
ml.c6gn.2xlarge 8 Not supported
ml.c6gn.4xlarge 16 Not supported
ml.c6gn.8xlarge 30 Not supported
ml.c6gn.12xlarge 30 Not supported
ml.c6gn.16xlarge 30 Not supported
ml.r6g.large 8 Not supported
ml.r6g.xlarge 16 Not supported
ml.r6g.2xlarge 30 Not supported
ml.r6g.4xlarge 30 Not supported
ml.r6g.8xlarge 30 Not supported
ml.r6g.12xlarge 30 Not supported
ml.r6g.16xlarge 30 Not supported
ml.r6gd.large 8 Not supported
ml.r6gd.xlarge 16 Not supported
ml.r6gd.2xlarge 30 Not supported
ml.r6gd.4xlarge 30 Not supported
ml.r6gd.8xlarge 30 Not supported
ml.r6gd.12xlarge 30 Not supported
ml.r6gd.16xlarge 30 Not supported
Serverless 5 Not supported