Amazon EC2 R8i and R8i-flex instances

R8id instances feature up to 22.8TB of NVMe SSD local instance storage — 3x more than R6id — and provide up to 3.3x higher memory bandwidth, delivering up to 43% higher performance compared to R6id instances. They are ideal for memory-intensive workloads that benefit from high-performance local storage, including in-memory databases, real-time big data analytics, large in-memory caches, and data processing applications.

R8in instances offer 600 Gbps network bandwidth and deliver up to 43% higher performance compared to previous generation R6in instances. They are ideal for workloads such as real-time big data analytics, caching fleets for AI/ML clusters, and distributed web scale in-memory caches.

R8ib instances offer up to 300 Gbps EBS bandwidth, 1,440K IOPS, and deliver up to 43% higher performance compared to previous generation R6ib instances. R8ib instances are best suited for workloads that benefit from high block storage performance, such as large commercial databases, data lakes, and SQL and NoSQL databases.

Many customers do not fully utilize all the compute resources of an EC2 instance. Those customers are therefore paying for performance that they don’t need. Amazon EC2 R8i-flex instances offer the easiest way to achieve improved price performance of memory-intensive workloads. Amazon EC2 Flex instances efficiently use compute resources with the ability to scale up to full compute performance most of the time. Flex instances are purpose-built to optimize cost and performance.

R8i-flex instances offer the easiest way to optimize costs for memory-intensive workloads. They deliver up to 20% better price performance compared to previous generation instances. R8i instances offer up to 15% better price performance compared to previous generation instances. R8i provides additional larger instance sizes, including two metal sizes, to run more demanding and larger-sized workloads.

R8i and R8i-flex instances add to the selection of EC2 instances on AWS. R8i-flex offers the most common sizes from large to 16xlarge, while R8i provides sizes scaling up to 96xlarge (including metal sizes), with varying amounts of vCPU, memory, networking, and storage. This allows for larger data processing and improved scaling for database workloads.

R8i-flex and R8i instances are built on the AWS Nitro System, a combination of dedicated hardware and lightweight hypervisor. These instances feature the latest sixth generation AWS Nitro Cards, which improve network throughput for workloads that handle small packets, such as web, application, and gaming servers. The new instances also support IBC feature, offering flexibility in allocating resources between network and Amazon Elastic Block Storage (Amazon EBS) bandwidth.

R8i-flex and R8i instances are powered by custom Intel Xeon 6 processors with a sustained all-core turbo frequency of 3.9 GHz. These custom processors offer the highest compute performance and fastest memory among comparable Intel processors in the cloud. Both instances include support for always-on memory encryption.

R8i and R8i-flex instances use DDR5 7200MT/s DIMMs, providing 2.5x higher memory throughput compared to previous generation instances. R8i-flex instances support up to 20 Gbps bandwidth to Amazon EBS and up 30 gigabits per second (Gbps) of networking bandwidth. R8i instances support up to 80 Gbps bandwidth to Amazon EBS and up to 100 Gbps of networking bandwidth. R8i instances also support Elastic Fabric Adapter (EFA) in the 48xlarge, 96xlarge, metal-48xl and metal-96xl sizes.

R8i and R8i-flex instances feature 4.6x larger L3 cache versus previous generation instances, significantly improving latency for CPU-based inference, scientific computing, and database workloads. Intel Xeon 6 processors offer enhanced built-in accelerators such as Advanced Matrix Extensions (AMX) with FP16 support on R8i and R8i-flex instances, enabling a wider range of CPU- based inference workloads.

The AWS Nitro System is the foundation for our next generation of EC2 instances that enables AWS to innovate faster, further reduce cost for our customers, and deliver added benefits like increased security and new instance types. These instances are built using the latest sixth generation AWS Nitro Cards, which offload and accelerate I/O for functions, increasing overall system performance. The new Nitro cards deliver up to 2x more network and 2x more EBS bandwidth over comparable previous generation instances.

R8i and R8i-flex instances support a new instance bandwidth configuration feature that offers flexibility in allocating resources between network and EBS bandwidth. This allows customers to scale network or EBS bandwidth by 25% and improve database performance, query processing, and logging speeds.