AWS Glue now supports the FindMatches ML Transform on Apache Spark 2.4.3 and AWS Glue version 1.0

Posted on: Nov 22, 2019

AWS Glue now supports running the FindMatches ML Transform in ETL scripts running on Spark 2.4.3 (Glue version 1.0). Previously, you were only able to use the FindMatches ML Transform in Spark 2.2.1 (Glue Version 0.9). 

In addition to supporting the latest version of Spark, ML Transforms can be called from Apache Spark ETL scripts written in Python 2, Python 3, or Scala.

This feature is now available in all the AWS regions where AWS Lake Formation is available.  

To learn more and get started with ML Transforms in AWS Glue, please visit our documentation.