Apache Spark 2.1.0 and updates to Apache Hive and Hue now available on Amazon EMR release 5.3.0

Posted on: Jan 26, 2017

You can now use upgraded versions of Apache Spark (2.1.0), Apache Hive (2.1.1), Apache Flink (1.1.4), Hue (3.11.0), and Apache Oozie (4.3.0) on Amazon EMR release 5.3.0. Apache Spark 2.1.0 resolves over 1,200 tickets, including better SparkR support for machine learning algorithms, improvements to Structured Streaming, and performance enhancements for Spark SQL. Hue 3.11.0 adds improvements to the SQL editor with a new autocompleter and a more advanced results grid. Flink 1.1.4, Hive 2.1.1, and Oozie 4.3.0 all have various improvements and bug fixes.

You can create an Amazon EMR cluster with release 5.3.0 by choosing release label “emr-5.3.0” from the AWS Management Console, AWS CLI, or SDK. You can specify Spark, Hue, Flink, Hive, and Oozie to install these applications on your cluster. Please visit the Amazon EMR documentation for more information about release 5.3.0, Spark 2.1.0, Hue 3.11.0, Flink 1.1.4, Hive 2.1.1, and Oozie 4.3.0.