Airflow
If you already have an Airflow instance up and running, you might want to reuse it to host the metadata workflows as well. Here we will guide you on the different aspects to consider when configuring an existing Airflow.
There are three different angles here:
Installing the ingestion modules directly on the host to enable the Airflow Lineage Backend.
Installing connector modules on the host to run specific workflows.
Installing the Airflow APIs to enable the workflow deployment through the UI.
Depending on what you wish to use, you might just need some of these installations. Note that the installation commands shown below need to be run in the Airflow instances.
Last updated