In ADF Pipeline is there any trigger or method if a particular job is failed we have to run it again?

Question

In ADF i have created workflows it means one workflow is dependent on other workflow like in this case for eg. 008_granular_--_model is dependent on 007_sow_retailersow_model. I am using event based trigger here. In every Execute_pipeline there is a databricks notebook that will be run. enter image description here

problem is grower_churn_notebook is sometimes failing but i want campaign_inseason to be run succesfully. if any model fails, campaign_inseason should run perfectly.

Is there any way through which i can do that?

Answer 1

Looking at your image, you have set campaign_inseason to run only if grower_churn finishes successfully. If you want it to run only when grower churn fails, connect it to the X (cross) endpoint instead of the tickmark endpoint.

You can also have it execute regardless of the outcome of grower_churn by connecting it to both the tickmark and the cross(X)