Posted On: Mar 3, 2022
Amazon EMR is the industry-leading cloud big data platform for processing vast amounts of data using open source tools such as Apache Spark, Apache Hive, Apache HBase, Apache Flink, Apache Hudi, and Presto. Today, we are excited to announce that Amazon EMR now supports auto termination of idle clusters in Europe (Milan), Asia Pacific (Hong Kong), Africa (Cape Town), and Middle East (Bahrain) regions.
Auto-terminating idle EMR clusters is a new feature that automatically terminates your EMR cluster if it has been idle, to reduce the cost without the need to manually monitor cluster activity. You can specify the idle timeout value when enabling auto-termination for both existing and new clusters and EMR will automatically terminate the cluster when it has been idle for specified time.
With this feature, Amazon EMR continuously samples key metrics associated with the workloads running on the clusters, and auto-terminates when the cluster is idle. This feature is available when launching EMR clusters from EMR Console, AWS CLI, AWS SDK, and AWS CloudFormation.
Auto-termination of idle EMR clusters is available on Amazon EMR release version 5.30.0 and 6.1.0 and later. You can use this feature across 20 regions globally: US East (Ohio, N. Virginia), US West (Oregon, N. California), Canada (Central), Europe (Ireland, Frankfurt, London, Paris, Stockholm, and Milan), South America (São Paulo), Asia Pacific (Mumbai, Seoul, Singapore, Sydney, Tokyo, and Hong Kong), Middle East (Bahrain) , and Africa (Cape Town).
To get started, read our auto-terminating idle EMR clusters documentation here.