Posted On: Nov 20, 2018
Amazon SageMaker is now integrated with Apache Airflow for building and managing your machine learning workflows. With this integration, multiple SageMaker operators including model training, hyperparameter tuning, model deployment, and batch transform are now available with Airflow.
Apache Airflow is an open-source platform to programmatically author, schedule, and monitor workflows that can be deployed in the cloud or on-premises. Airflow uses operators to represent tasks that are going to be executed in a workflow. SageMaker joins other AWS services such as Amazon S3, Amazon EMR, AWS Batch, AWS Redshift, and many others as contributors to Airflow with different operators.
Amazon SageMaker operators for Airflow are now available as open source software. Visit the documentation for additional details.