Posted On: Nov 6, 2018
You can now use Apache Flink 1.6.0, Apache Zeppelin 0.8.0, and S3 Select with Apache Hive and Presto on Amazon EMR release 5.18.0. Flink 1.6.0 adds several new features and updates, including native support for state TTL that allows you to control access to Flink states and support for HTTP/REST based job submissions that allows better integration with container environments on the cluster. It also features several SQL and Table API improvements that simplify the executions of streaming and batch queries and adds SQL support for Avro data format. Zeppelin 0.8.0 features support for running Spark interpreter in Apache Hadoop YARN cluster mode, support for Ipython interpreter, and ability to use Apache HDFS as backend storage for saving and reading Zeppelin notebook files.
With EMR release 5.18.0, you can now use S3 Select with Hive and Presto. S3 Select allows applications to retrieve only a subset of data from an object stored in Amazon S3. This improves performance as it reduces the amount of data that needs to be transferred to and processed by the EMR cluster when running Hive and Presto queries. Please visit S3 Select with Hive and S3 Select with Presto pages to learn more about these features.
Additionally, with this release, you can also use the upgraded versions of Apache Spark 2.3.2, Apache HBase 1.4.7, and Presto 0.210.
You can create an Amazon EMR cluster with the release 5.18.0 by choosing the release label “emr-5.18.0” from the AWS Management Console, AWS CLI, or SDK. You can select Flink, HBase, Presto, and Zeppelin to install these applications when you launch your EMR cluster. Please visit the Amazon EMR documentation for more information about EMR release 5.18.0, Flink 1.6.0, HBase 1.4.7, Spark 2.3.2, Presto 0.210, and Zeppelin 0.8.0.
Amazon EMR release 5.18.0 is now available in all supported regions for Amazon EMR.
You can stay up to date on EMR releases by subscribing to the RSS feed for EMR release notes. Use the RSS icon at the top of the EMR Release Guide to link the feed URL directly to your favorite feed reader.