I have models in dbt but I after dbt test, I want to trigger an API call which could kick-off my AWS glue job. Any suggestions for workaround on this?
Approaches tried:
Dbt —> fal script (which runs python code) —> py script could call glue job Blocker: later found that they are not running Python on dbt Cloud, they are running it in Github actions
Dbt —> Rest/POST API with on-run-end (hooker) —> glue job Blocker: can’t find any instance where API calls are done from dbt (we could call dbt jobs from API but not the other way around)
Dbt new table —> SNS —> lambda fn —> glue job