Amazon Managed Workflows for Apache Airflow (MWAA) Documentation

Airflow deployment

Managed Workflows leverage open source Apache Airflow product. You can deploy Managed Workflows from AWS Management Console, CLI, AWS CloudFormation, or AWS SDK leveraging the Airflow user experience.

Scaling

With Managed Workflows, there’s worker scaling without configuration. Worker monitoring is designed so that when workers are over-burdened, additional workers are provisioned, and then decommissioned as needed.

Built-in security

Managed Workflows keep your data secure using Amazon’s Virtual Private Cloud (VPC), and data is automatically encrypted using AWS Key Management Service (KMS), so your workflow environment is secure by default.

Workflow monitoring in AWS or on-premises

Managed Workflows sends Apache Airflow system metrics and logs to Amazon Cloudwatch, so that you can view task execution delays and workflow errors across one or more environments.

Plug-in integration

Managed Workflows connect to the AWS resources required for your workflows including Athena, Batch, Cloudwatch, DynamoDB, DataSync, EMR, ECS/Fargate, EKS, Firehose, Glue, Lambda, Redshift, SQS, SNS, Sagemaker, and S3. You can use Managed Workflows to connect to your own on-premises resources.

Additional Information

For additional information about service controls, security features and functionalities, including, as applicable, information about storing, retrieving, modifying, restricting, and deleting data, please see https://docs.aws.amazon.com/index.html. This additional information does not form part of the Documentation for purposes of the AWS Customer Agreement available at http://aws.amazon.com/agreement, or other agreement between you and AWS governing your use of AWS’s services.