Posted On: Oct 26, 2021
Today we are announcing the general availability of Amazon EC2 DL1 instances powered by Gaudi accelerators from Habana Labs, an Intel company. EC2 DL1 instances deliver up to 40% better price performance than current generation GPU-based EC2 instances for training deep learning models and are optimized for workloads such as image classification, object detection and natural language processing.
These instances feature 8 Gaudi accelerators with 32 GB of high bandwidth memory (HBM), 768 GiB of system memory, custom 2nd generation Intel Xeon Scalable processors, 400 Gbps of networking throughput, and 4 TB of local NVMe storage. Customers can quickly and easily get started with DL1 instances using Habana SynapseAI SDK, which is integrated with leading machine learning frameworks such as TensorFlow and PyTorch. Customers can seamlessly migrate their existing machine learning models currently running on GPU-based or CPU-based instances onto DL1 instances, with minimal code changes.
Customers can launch DL1 instances using AWS Deep Learning AMIs or using Amazon Elastic Kubernetes Service (Amazon EKS) or Amazon Elastic Container Service (Amazon ECS) for containerized applications.
DL1 instances are now available in US East (N. Virginia) and US West (Oregon) regions. Customers can purchase DL1 instances as On-Demand Instances, Reserved Instances, Spot Instances, or as part of Savings Plan.