I am working on KubernetesPodOperator for one of the development. In that, I have used this to generate the files in GCP. I tried the below approach and it was working fine too. The KubernetesPodOperator task shows completed(green) in Airflow UI interface, but looks like it is keep on running in the backend.
Can someone help me on this to fix this continuous generation of files.
Is there anyway to kill the running kubernetescluster or pod if any. Or is there any other way/parameter needs to be added to run the task with KubernetesPodOperator
I tried multiple approaches but the log show, Deleting Pod at the completion of the task
Turns out that the
is_delete_operator_pod=Trueis deprecated, use on_finish_action="delete_pod"pls see comments in this file: https://github.com/apache/airflow/blob/main/airflow/providers/cncf/kubernetes/operators/pod.py
or in
https://airflow.apache.org/docs/apache-airflow-providers-cncf-kubernetes/stable/operators.html#kubernetespodoperator