I am looking to create a dependency graph for a few pipelines in my cluster. I am trying to show the start and end point of my data and all the flows of data in between the two points. I am looking to use either apache airflow or apache falcon to accomplish this task. Please let me know if you have any suggestions on what tool to use and how to get started with this project. Please also link any documentation related to apache falcon. Thank you.
Apache Airflow has a nice UI which allows you to view your DAGs as a tree, graph, or even Gantt chart. Check this out for more information.