Posted On: Apr 4, 2024
We are pleased to announce general availability of Amazon EC2 P5, C6i, C7i, M6i, M7i, R6i, and R7i instances on SageMaker notebooks.
Amazon EC2 M7i, R7i, and C7i instances are powered by custom 4th generation Intel Xeon Scalable processors and deliver up to 15% better price performance compared to their previous generation (M6i, R6i, and C6i) instances. M6i, R6i, and C6i instances are powered by 3rd generation Intel Xeon Scalable processors. You can use M, R and C instance types for CPU-based, compute-intensive Machine Learning (ML) workloads.
P5 instances feature up to 8 of the latest NVIDIA H100 Tensor Core GPUs. P5 instances complement NVIDIA H100 Tensor Core GPUs with 2x higher CPU performance, 2x higher system memory, and 4x higher local storage as compared to previous-generation GPU-based instances. You can use P5 instances for interactive model training for increasingly complex large language models (LLMs) and diffusion models powering the most demanding generative artificial intelligence (AI) applications. These applications include question answering, code generation, video and image generation, and speech recognition.
Visit developer guides for instructions on setting up and using JupyterLab and CodeEditor applications on SageMaker Studio and SageMaker notebook instances. For pricing and regional availability information on these instances, please visit our pricing page.