In Azure DataBricks i have scheduled one job with notebook attached to simple python file.

[![dbutils.widgets.text("input", "","")
y = getArgument("input")
print ("Param -\'input':")
print (y)][1]][1]

Cluster: D8s_v3 ( 1 Worker)

even though its quite simple code its take about 9 to 10 second to execute by DataBricks Jobs. If i run python file directly it execute under 1 second.

Please guide me to optimize it for DataBricks Jobs

enter image description heretg.png

0 Answers