What are good ways to provide big "scratch" storage to Kubernetes jobs/deployments that require a lot of disk?
I read about ephemeral volumes and it seems that the ideal thing for the case is to mount emptyDir volumes. My problem is that emptyDir volumes are mounted under /var on the host by default (see here), and I have hard limits on the size of the /var partition, therefore I cannot get enough space to use as "scratch" space for my expensive on-disk pods.
Is there a way to change the default location of where ephemeral storage is mounted?
I couldn't find it anywhere.
I cannot find any useful options in the emptyDir spec.
I wouldn't want to use persistent volume claims because I don't need to persist anything.
Nor I want to mount empty directories in big partitions outside of /var from the host as hostPath volumes, because that would be abusing hostPaths which have a different semantics than what I need. (Although that would work, but it seems kind of a hack).
Are there other solutions that one could employ?