Amazon EC2 G6 Instances

G6 instances deliver up to 2x higher performance for deep learning inference compared to G4dn instances. They are powered by L4 GPUs that feature fourth-generation tensor cores and are a highly performant and cost-efficient solution for customers who want to use NVIDIA libraries such as TensorRT, CUDA, and cuDNN to run their ML applications.

G6 instances deliver up to 2x higher graphics performance than G4dn instances. They are powered by L4 GPUs that feature third-generation RT cores and support NVIDIA RTX technology. This makes them ideal for rendering realistic scenes faster, running powerful virtual workstations, and supporting graphics heavy applications at higher fidelity and resolution. Gr6 instances support vCPU: RAM ratio of 1:8 that makes them well suited for graphics workloads with higher memory requirements.

G6 instances are built on the AWS Nitro System, a combination of dedicated hardware and lightweight hypervisor which delivers practically all of the compute and memory resources of the host hardware to your instances for better overall performance and security. With G6 instances, the Nitro system provisions the GPUs in a pass-through mode, providing performance comparable to bare-metal.

G6 instances feature NVIDIA L4 Tensor Core GPUs that deliver high performance for graphics-intensive and machine learning applications. Each instance features up to 8 L4 Tensor Core GPUs that come with 24 GB of memory per GPU, third-generation NVIDIA RT cores, fourth-generation NVIDIA Tensor Cores, and DLSS 3.0 technology. NVIDIA L4 GPUs include four video decoders and two video encoders and have AV1 hardware-encoding capabilities.

G6 instances offer NVIDIA RTX Enterprise and gaming drivers to customers at no additional cost. NVIDIA RTX Enterprise drivers can be used to provide high quality virtual workstations for a wide range of graphics-intensive workloads. NVIDIA gaming drivers provide unparalleled graphics and compute support for game development. G6 instances also support CUDA, cuDNN, NVENC, TensorRT, cuBLAS, OpenCL, DirectX 11/12, Vulkan 1.3, and OpenGL 4.6 libraries.

G6 instances come with up to 100 Gbps of networking throughput enabling them to support the low latency needs of machine learning inference and graphics-intensive applications. 24 GB of memory per GPU along with support for up to 7.52 TB of local NVMe SSD storage enable local storage of large models and datasets for high performance machine learning training and inference. G6 instances can also store large video files locally resulting in increased graphics performance and the ability to render larger and more complex video files.

G6 instances are built on the AWS Nitro System, which is a rich collection of building blocks that offloads many of the traditional virtualization functions to dedicated hardware and software to deliver high performance, high availability, and high security while also reducing virtualization overhead.