If you are using a cloud provider, you can leverage spot instances to reduce your ML training cost.
Polyaxon docs has a section for spot instances and preemptible VMs.
This github issues discuss how to use a pool of preemptible GPUs that are automatically used whenever experiments or a hyperparameter search is created in Polyaxon.