Build multimodal search with EmbeddingGemma 2 on Polyaxon
Deploy EmbeddingGemma 2 as a Polyaxon GPU service, then use text or an image to search a mixed collection of documents and photos.
LLMOpsInferenceRAG
All blog articles
Practical guides to building, running, and improving ML and AI in production.
All articles
Page 2 of 22
Start large ML containers with lazy image pulling
Use eStargz and containerd for lazy image pulls, then measure a Polyaxon GPU job through its first completed CUDA operation.
KubernetesContainersPerformance
Autoresearch as a controlled experiment
A design note on autonomous experimentation: fixed protocols, selection bias, independent evaluation, and durable research campaigns in Polyaxon.
RoadmapAI AgentsExperimentation
Build a coding agent with Polyaxon sandboxes
Give an open model a bounded read, edit, and check loop in a Polyaxon workspace, then retain the patch and evidence behind its completion claim.
AI AgentsSandboxCode Execution
Extract invoice fields with Qwen-VL on Polyaxon
Serve an open vision-language model on your GPU cluster, extract typed invoice fields, and evaluate whether the values actually match the document.
LLMOpsInferenceEvaluation
Measure MIG and GPU time-slicing under co-load
Run synchronized training and inference workers on Polyaxon, compare MIG with time-slicing, and measure the shared interval rather than misleading solo utilization.
KubernetesGPUPerformance
Size GPU memory for LLM serving
Calculate Qwen3-4B weight and KV-cache storage, understand what the estimate excludes, and use a Polyaxon service to check the actual capacity.
LLMOpsInferenceGPU
Profile a slow PyTorch training run on Polyaxon
Capture a short CPU/CUDA trace, identify whether input loading or GPU work is delaying training, and measure a targeted change without profiler overhead.
MLOpsPyTorchGPU
Prioritize GPU jobs without preempting running workloads
Give urgent GPU evaluations or notebooks higher Kubernetes scheduling priority without evicting running training Pods, and select the policy in Polyaxon.
KubernetesGPUScheduling
Benchmark vLLM speculative decoding on Polyaxon
Compare ordinary decoding with prompt-lookup proposals under the same model, workload, and GPU allocation, including latency, failures, and output checks.
LLMOpsvLLMInference
Tune PyTorch models with Polyaxon
Tune a PyTorch model's depth, width, dropout, optimizer, and learning rate with native TPE, GPU trials, and validation accuracy in Polyaxon.
PolyaxonHyperparameter TuningPyTorch
The Polyaxon agent sandbox roadmap
Our plans for persistent sandbox workspaces, suspend/resume, activity-aware idle suspension, and ready pools on Kubernetes—and where AX and Substrate differ.
RoadmapSandboxesAI Agents
Assign project owners without changing organization roles
Give a teammate responsibility for a Polyaxon project while keeping their organization role and your team's access restrictions in place.
PolyaxonAdministrationCollaboration
Protect notebook volumes with ReadWriteOncePod
Restrict a Kubernetes notebook workspace PVC to one Pod, mount it in a Polyaxon service, and hand access to a replacement notebook.
KubernetesStorageNotebooks
Run batch inference with vLLM on Polyaxon
Generate predictions from a JSONL prompt file with vLLM, schedule the work on a Polyaxon GPU agent, and save the results as run artifacts.
LLMOpsvLLMInference
Check agent access before starting workloads
Polyaxon checks Kubernetes access and the default artifact store before managed agents begin syncing. Find failed checks and correct credentials, permissions, or mounts.
ComputeKubernetesAdministration
Create and automate Polyaxon sandboxes from Python
Create a sandbox service with SandboxClient, choose its image, run Python, download the output, and stop the workspace from one Python script.
SandboxesPythonTutorials
Set GPU quotas for shared Kubernetes namespaces
Limit aggregate GPU requests with ResourceQuota, supply CPU and memory defaults, and align Polyaxon resource profiles and queues with namespace budgets.
KubernetesGPUScheduling
Tune hyperparameters with native TPE in Polyaxon
Use completed trial results to guide hyperparameter choices with native TPE, run GPU training trials, and compare validation loss in Polyaxon.
PolyaxonHyperparameter TuningExperimentation
Query runs and model versions across projects
Use Polyaxon's organization and team APIs to inspect GPU workloads by agent, count model versions, and calculate job failure rates across projects.
PolyaxonPythonMonitoring
Keep inference available during Kubernetes node drains
Set a PodDisruptionBudget around usable inference capacity, inspect blocked evictions, and account for replacement GPUs and model warmup.
KubernetesInferenceReliability
Optimize one model three ways with NVIDIA Model Optimizer on Polyaxon
Compare INT8 quantization, FastNAS pruning, and distillation against one tracked baseline, then measure the candidate that meets your accuracy floor.
MLOpsModel OptimizationTraining
Serve multiple LoRA adapters with vLLM on Polyaxon
Deploy two task-specific LoRA adapters over one Qwen base model, select them by name, and measure quality and shared GPU capacity with Polyaxon.
LLMOpsvLLMInference
Run persistent Dask and Ray clusters on Polyaxon
Launch Dask or Ray clusters with Polyaxonfiles, submit repeated work, and control worker capacity, durable outputs, and cluster lifetimes.
ProductDaskRay