Roadmap

UI improvements for Airflow and Lineage

For context, we build Lineage for our DAGs by writing inlets/outlets inside DAGs. We would like to improve this experience a bit:
— Currently Airflow Lineage builds based on Tasks, which doesn’t make much sense to us. It clutters space too much and makes Lineage confusing. It would be nice to have a toggle-button, which would mearge all tasks into single pipeline, and connect all its task’s upstream/downstream to this pipeline block
— It would me more convenient to be able to open Lineage for DAG Pipeline from Pipeline entity in Datahub. Currently you can only open it’s Lineage from specific tasks related to this DAG