AWS Batch now supports GPU scheduling on G3, G3s, and G4 instance families
AWS Batch has added support for GPU scheduling to G3, G3s, and G4 instance families, in addition to existing support for GPU scheduling on P2 and P3 families.
GPU scheduling allows you to specify the number and type of accelerators your jobs require as job definition input variables in AWS Batch. AWS Batch will scale up instances appropriate for your jobs based on the required number of GPUs and isolate the accelerators according to each job’s needs, so only the appropriate containers can access them.
The recently-released G4 instances deliver the industry’s most cost-effective GPU instance for deploying machine learning models in production and graphics-intensive applications. G4 instances provide the latest generation NVIDIA T4 GPUs, AWS custom Intel Cascade Lake CPUs, up to 100 Gbps of networking throughput, and up to 1.8 TB of local NVMe storage.
To get started with AWS Batch please click here.