Posted On: Jan 11, 2022
Amazon SageMaker training jobs now support ml.g5 instances, powered by NVIDIA A10G Tensor Core GPUs.
ml.g5 instances feature up to 8 NVIDIA A10G Tensor Core GPUs and 2nd generation AMD EPYC processors. They also support up to 192 vCPUs, up to 100 Gbps of network bandwidth, and up to 7.6 TB of local NVMe SSD storage. Customers can choose the most appropriate instance size from eight options, offering between one and eight GPUs.
SageMaker Training supports ml.g5 instances today in the AWS US East (N. Virginia) and US West (Oregon) regions.