Amazon EC2 M8i and M8i-flex Instances

M8id instances feature up to 22.8TB of NVMe SSD local instance storage — 3x more than M6id instances — and provide up to 3.3x higher memory bandwidth, delivering up to 43% higher performance compared to M6id instances. Amazon EC2 M8id instances are ideal for workloads that require a balance of compute and memory resources along with high-speed, low-latency local block storage, including data logging and media processing. M8id instances will also benefit applications that need temporary storage of data, such as batch and log processing, and applications that need caches and scratch files.

M8in instances deliver 600 Gbps network bandwidth — the highest among enhanced networking EC2 instances — delivering up to 43% higher performance compared to previous generation M6in instances. M8in instances are ideal for network-intensive workloads such as real-time big data analytics, distributed web scale in-memory caches, caching fleets for AI/ML clusters, and Telco applications including 5G User Plane Function (UPF).

M8ib instances offer up to 300 Gbps EBS bandwidth, 1,440K IOPS, and deliver up to 43% higher performance compared to previous generation instances. M8ib instances are best suited for workloads that benefit from high block storage performance, such as high-performance file systems and NoSQL databases.

M8ine instances deliver up to 2.5 times higher packet performance per vCPU, up to 2x higher network throughput for traffic going through Internet gateways, and up to 43% higher performance compared to previous generation M6in instances. M8ine instances are ideal for workloads requiring high packet performance to process small packets, for security and network virtual appliances such as virtual firewalls, load balancers, DDoS protection systems, as well as Telco 5G UPF applications.

Many customers do not fully utilize all the compute resources of an EC2 instance. Those customers are therefore paying for performance that they don’t need. Amazon EC2 M8i-flex instances offer the easiest way to achieve improved price performance for general-purpose workloads. Amazon EC2 Flex instances efficiently use compute resources with the ability to scale up to full compute performance majority of the time. Flex instances are purpose-built to optimize cost and performance.

M8i-flex instances offer the easiest way to optimize costs for general-purpose workloads. They deliver up to 15% better price performance compared to previous generation instances. M8i provides additional larger instance sizes, including two metal sizes, to run more demanding and larger-sized workloads.
 

M8i-flex offers the most common sizes from large to 16xlarge, while M8i provides sizes scaling up to 96xlarge (including metal sizes), with varying amounts of vCPU, memory, networking, and storage. This allows for larger data processing and improved scaling for general-purpose workloads.

M8i and M8i-flex instances are built on the AWS Nitro System, a combination of dedicated hardware and lightweight hypervisor. These instances feature the latest sixth generation AWS Nitro Cards, which improve network throughput for workloads that handle small packets, such as web, application, and gaming servers. The new instances also support IBC feature, offering flexibility in allocating resources between network and Amazon Elastic Block Storage (Amazon EBS) bandwidth.

M8i and M8i-flex instances are powered by custom Intel Xeon 6 processors with a sustained all-core turbo frequency of 3.9 GHz. These custom processors offer the highest compute performance and fastest memory among comparable Intel processors in the cloud. Both instances include support for always-on memory encryption.

M8i and M8i-flex instances use DDR5 7200MT/s DIMMs, providing 2.5x higher memory throughput compared to previous generation instances. M8i-flex instances support up to 20 Gbps bandwidth to Amazon EBS and up to 30 gigabits per second (Gbps) of networking bandwidth. M8i instances support up to 80 Gbps bandwidth to Amazon EBS and up to 100 Gbps of networking bandwidth. M8i instances also support Elastic Fabric Adapter (EFA) in the 48xlarge, 96xlarge, metal-48xl, and metal-96xl instance sizes.

M8i and M8i-flex instances feature 4.6x larger L3 cache versus previous generation instances, significantly improving latency for CPU-based inference, scientific computing, and database workloads. Intel Xeon 6 processors offer enhanced built-in accelerators such as Advanced Matrix Extensions (AMX) with FP16 support on M8i and M8i-flex instances, enabling a wider range of CPU-based inference workloads.

The AWS Nitro System is the foundation for our next generation of EC2, enabling AWS to innovate faster, further reduce cost for our customers, and deliver added benefits like increased security and new instance types. These instances are built using the latest sixth generation AWS Nitro Cards, which offload and accelerate I/O for functions, increasing overall system performance. The new Nitro cards deliver up to 2x more network and 2x more EBS bandwidth over comparable previous generation instances.

M8i and M8i-flex instances support a new instance bandwidth configuration feature that offers flexibility in allocating resources between network and EBS bandwidth. This allows customers to scale network or EBS bandwidth by 25% and improve database performance, query processing, and logging speeds.