AWS Glue enables running Apache Spark SQL queries

Posted on: Mar 14, 2019

AWS Glue Data Catalog is an Apache Hive Metastore compatible catalog. Starting today, customers can configure their AWS Glue jobs and development endpoints to use AWS Glue Data Catalog as an external Apache Hive Metastore. This allows them to directly run Apache Spark SQL queries against the tables stored in the AWS Glue Data Catalog.

This feature is now available in all supported regions for AWS Glue. To learn more about how you can take advantage of this new capability, please visit our documentation.