Posted On: Sep 28, 2023
Amazon EC2 P5 instances which deliver the highest performance in Amazon EC2 for deep learning and high performance computing (HPC) applications are now available in the US East (Ohio) region.
You can use P5 instances for training and deploying increasingly complex large language models (LLMs) and diffusion models powering the most demanding generative AI applications. This includes question answering, code generation, video and image generation, speech recognition, and more. You can also use P5 instances to deploy demanding HPC applications at scale in pharmaceutical discovery, seismic analysis, weather forecasting, and financial modeling.
P5 instances are powered by the latest NVIDIA H100 Tensor Core GPUs and provide 2x higher CPU performance, 2x higher system memory, and 4x higher local storage as compared to previous-generation GPU-based instances. They provide market-leading scale-out capabilities for distributed training and tightly coupled HPC workloads with up to 3,200 Gbps of networking using second-generation Elastic Fabric Adapter (EFA) technology. To address customer needs for large scale at low latency, P5 instances are deployed in Amazon EC2 UltraClusters, providing petabit-scale nonblocking interconnect across up to 20,000 H100 GPUs.
With this regional expansion, Amazon EC2 P5 instances are now available in the US East (N. Virginia), US East (Ohio) and US West (Oregon) regions.
To learn more about P5 instances, see Amazon EC2 P5 Instances.