If you are using a cloud provider, you can leverage spot instances to reduce your ML training cost.

Polyaxon docs has a section for spot instances and preemptible VMs.

This github issues discuss how to use a pool of preemptible GPUs that are automatically used whenever experiments or a hyperparameter search is created in Polyaxon.