IntegrationsCrusoe Cloud
Clouds and KubernetesCrusoe Cloud

Polyaxon & Crusoe Cloud

How to use Polyaxon and Crusoe Cloud together

Polyaxon+

Crusoe Managed Kubernetes uses a shared-responsibility model. Crusoe operates the underlying cloud and control plane, while your platform team still makes explicit choices for node pools, access, add-ons, storage use, workload policy, and some network configuration.

See the Crusoe Managed Kubernetes for the upstream configuration and requirements.

Prerequisites

  • A Crusoe Managed Kubernetes cluster with the required GPU node pool and NVIDIA components.
  • Reviewed cluster access, network, storage class, registry, DNS, and workload identity configuration.
  • The cluster connected to Polyaxon by installing Polyaxon Agent (compute cluster), with namespace permissions and a queue or preset selecting that node pool.

Connect the cluster

Follow Connect Kubernetes to Polyaxon to install Polyaxon Agent (compute cluster), configure storage and queues, and submit the shared GPU visibility example. Use the same namespace and queue that will run your workloads.

The example only checks GPU allocation and driver visibility. Validate storage, identity, and multi-node networking separately using the provider requirements below.

Provider requirements

  • Record the owner for each item in Crusoe's shared-responsibility model before production rollout.
  • Keep cluster, node-pool, add-on, compute-cluster connection, queue, and preset configuration in version control.
  • Revalidate GPU, storage, identity, DNS, and network behavior after cluster or node-pool changes.
  • Decide whether scaling is managed through fixed node pools or an AutoClusters configuration before setting queue expectations.
  • Run a collective communication test on the exact nodes and interfaces used by distributed training.

For distributed training, continue with NCCL and RCCL validation.

For help choosing a provider, see Choosing GPU infrastructure for Polyaxon.

Troubleshooting

The GPU resource is missing

Check node-pool readiness, NVIDIA component status, kubelet capacity, and whether the queue selector and tolerations match the GPU nodes.

The operation cannot mount its volume

Verify the requested storage class, CSI driver state, availability-zone constraints, permissions, and whether the workload expects persistent or local storage.

The connected compute cluster cannot submit or collect logs

Verify the Polyaxon Agent deployment, cluster access, namespace RBAC, network policy, registry credentials, queue routing, and control-plane connectivity.

References