Amazon EMR support prioritized and capacity-optimized-prioritized allocation strategies for EC2 instances
We are excited to announce that Amazon EMR on EC2 now supports two new allocation strategies for Instance Fleets - prioritized for On-Demand instances and capacity-optimized-prioritized for Spot instances. Allocation strategies let you determine how EMR selects from your list of specified instance types and Availability Zones to fulfill your desired capacity. These new strategies give you more control and flexibility when provisioning instances for your EMR workloads.
With today’s launch, you can use a prioritized list to determine the order in which EMR should attempt to provision your compute capacity. This new feature allows you to specify a priority for each instance type in your instance fleet configuration. For On-Demand instances, EMR will first attempt to fulfill capacity using the highest priority instance type. If EMR cannot fulfill the entire capacity using that instance type, it will then launch instances with the next highest priority, and so on. For Spot instances, EMR will optimize for capacity first, but will honor instance type priorities on a best-effort basis. This is great for workloads where the possibility of disruption must be minimized, but preferences for certain instance types matter.
This feature is available for all EMR 5.12.1 and later releases where allocation strategy is supported in all AWS Regions, including the AWS GovCloud (US) Regions, where Amazon EMR on EC2 is available. Customers can easily configure these strategies through the EMR API, CLI, SDK, console, and CloudFormation. Review our allocation strategy for instance fleet documentation to learn more.
8/26/2024 - This post has been updated to accurately reflect the EMR releases that support allocation strategy for EC2 instances.