Amazon Managed Workflows for Apache Airflow (MWAA)

Amazon Managed Workflows for Apache Airflow (MWAA) is a fully managed service that makes it easy to run and scale Apache Airflow. This open-source tool efficiently orchestrates data pipelines, ETL processes, and other complex workflows. With MWAA, organizations can build, schedule, and monitor workflows without managing the underlying infrastructure.

Return to list

Benefits and Use Cases

• Trigger Airflow DAGs on a schedule or on demand to automate ETL processes, machine learning, and other data workflows to Control and manage your data pipelines at scale, seamlessly.

• Centralize oversight of DAG execution status and task progress in Automic with real time monitoring

• Access DAG run logs and failure details to support compliance and troubleshooting.

Example Use Case: Data Pipeline Orchestration and Monitoring

Execute scheduled or on-demand Airflow DAGs to orchestrate ETL workflows that extract, transform, and load data across systems. Monitor these DAG status and individual task progress in real time and automatically recover from failures by triggering retries or fallback DAGs based on scheduler logic.

Automic Features

✓ Schedule execution of Apache Airflow DAGs

✓ Monitor to completion Airflow DAGs

✓ Retrieve DAG logs for problem diagnosis

✓ Alert on failure of DAG processing

✓ Create dependencies between DAG executions

✓ Incorporate DAG processing in existing enterprise automation workflows including dependency enforcement

Additional Information

» Documentation » Download