AWS Glue now provides additional ETL job metrics

Posted on: Jul 13, 2018

AWS Glue now provides additional Apache Spark metrics for better debugging and profiling of ETL jobs. Customers can easily track runtime metrics such as bytes read and written, memory usage and CPU load of the driver and executors, and data shuffles among executors from the Glue Console.

These metrics help you debug code, identify data issues, and plan CPU capacity. You can also setup alarms in Amazon CloudWatch on specific Job conditions. To learn more about these metrics and how you can use them, please visit our documentation.

AWS Glue is available in the AWS Regions US East (N. Virginia), US East (Ohio), US West (Oregon), EU (Frankfurt), EU (Ireland), EU(London), Asia Pacific (Mumbai), Asia Pacific (Seoul), Asia Pacific (Singapore), Asia Pacific (Sydney), and Asia Pacific (Tokyo).