Posted On: Sep 25, 2017
You can now view Apache Spark application history and YARN application status in the Amazon EMR console. Application history is updated throughout runtime, and the history is available for up to seven days after the application is complete. Additionally, application history is still viewable after you terminate your Amazon EMR cluster. The console now includes the list of running and completed YARN applications on your Amazon EMR cluster. For each Spark application, you can drill down into granular information and easily view logs in Amazon S3 for each Spark job, task, stage, and executor.
You can view your Amazon EMR cluster’s YARN application list and Spark application history on the Application History tab on the Cluster Details page in the Amazon EMR console. Application history in the Amazon EMR console is supported on Amazon EMR release 5.8.0 or later. Please visit the Amazon EMR documentation for more information about viewing application history in the console.
Application history in the Amazon EMR console is available in all supported regions for Amazon EMR except GovCloud and Beijing.