Why Amazon EC2 P6e-GB200 UltraServers and P6-B200 instances?
Amazon Elastic Compute Cloud (Amazon EC2) P6e-GB200 UltraServers, accelerated by NVIDIA GB200 NVL72, offer the highest GPU performance in Amazon EC2. They feature over 20x compute and over 11x memory under NVIDIA NVLinkTM compared to P5en instances. P6e-GB200 UltraServers are ideal for the most compute- and memory-intensive AI workloads, such as training and deploying frontier models at the trillion-parameter scale.
Amazon EC2 P6-B200 instances, accelerated by NVIDIA Blackwell GPUs, are an ideal option for medium-to-large scale training and inference applications. They offer up to 2x performance compared to P5en instances for AI training and inference.
P6e-GB200 UltraServers and P6-B200 instances enable faster training for next-generation AI models and improve performance for real-time inference in production. You can use P6e-GB200 UltraServers and P6-B200 instances to train frontier foundation models (FMs) such as mixture of experts and reasoning models and deploy them in generative and agentic AI applications such as content generation, enterprise copilots, and deep research agents.
Benefits
Features
Product Details
Instance types
Instance Size
|
Blackwell GPUs
|
GPU memory (GB)
|
vCPUs
|
System memory (GiB)
|
Instance storage (TB)
|
Network bandwidth (Gbps)
|
EBS bandwidth (Gbps)
|
Available in EC2 UltraServers
|
---|---|---|---|---|---|---|---|---|
p6-b200.48xlarge
|
8 |
1,440 HBM3e |
192 |
2048 |
8 x 3.84 |
8 x 400 |
100 |
No |
p6e- gb200.36xlarge
|
4 |
740 HBM3e |
144 |
960 |
3 x 7.5 |
4 x 400 |
60 |
Yes |
P6e-GB200 instances are only available in UltraServers
UltraServer types
Instance Size
|
Blackwell GPUs
|
GPU memory (GB)
|
vCPUs
|
System memory (GiB)
|
UltraServer Storage (TB)
|
Aggregate EFA bandwidth (Gbps)
|
EBS bandwidth (Gbps)
|
Available in EC2 UltraServers
|
---|---|---|---|---|---|---|---|---|
u-p6e-gb200x72
|
72 |
13320 |
2529 |
17280 |
405 |
28800 |
1080 |
Yes |
u-p6e-gb200x36
|
36 |
6660 |
1296 |
8640 |
202.5 |
14400 |
540 |
Yes |
Getting started with ML use cases
Did you find what you were looking for today?
Let us know so we can improve the quality of the content on our pages