Apache Airflow

Apache Airflow is an open-source platform created to programmatically author, schedule, and monitor workflows. This Universal Extension provides the capability to integrate with an Apache Airflow Standalone Server or Google Cloud Composer Airflow and use it as part of your end-to-end UC workflow, allowing high-level visibility and orchestration of data-oriented jobs or pipelines.

You gain many enterprise-level benefits by using the Universal Automation Center to control Airflow. Notable benefits include:

• Run your Airflow data pipelines in realtime by using event-based triggers from the UC
• Add Airflow tasks to broader business process workflows in the UC
• Gain observability of your Airflow workflows - with proactive alerts from the the UC

Read this article to learn more about the benefits of integrating Airflow with the Universal Automation Center.

Key-Features

This Universal Extension provides the following key features:

Actions

• Trigger a DAG run and optionally wait until the DAG was reached "success" or "failure".
• Information retrieval of a specific DAG Run.
• Information retrieval for a task that is part of a specific DAG Run.

• Basic authentication for Stand Alone Airflow Server.
• Service Account Private Key for Google Cloud Composer.

• Capability to use HTTP or HTTPS proxy instead of direct communication to Stand Alone Airflow Server.

What's new v 2.0.0

The latest release provides the ability to integrate with Google Cloud Composer Airflow Server. Furthermore, provides the ability to configure Action "Trigger DAG Run", by passing JSON configuration parameters.