Build a shared library of agent evaluators
Package application-owned agent evaluators as versioned Polyaxon components with typed contracts, reusable execution profiles, and consistent result evidence.
AI AgentsEvaluationAutomation
Latest articles
The latest guides, tutorials, and product updates.
Build evaluation leaderboards with Polyaxon joins
Use Polyaxon joins to select comparable evaluation runs and build application-owned leaderboards with explicit cohort, completeness, and artifact evidence.
AI AgentsEvaluationAutomation
Schedule agent evaluations and backfill missed days
Run recurring agent evaluations and controlled historical backfills with Polyaxon schedules, date-range matrices, explicit window identity, and fresh results.
AI AgentsEvaluationAutomation
Give coding agents controlled access to Polyaxon operations
Build a coding assistant around Polyaxon run queries, sandbox commands, component versions, and reviewable operations that preserve project context and execution evidence.
AI AgentsMLOpsAutomation
Cache pipeline steps without hiding LLM regressions
Cache deterministic Polyaxon preparation steps while forcing fresh LLM evaluations, using explicit dependency identities and separate cache policies.
AI AgentsEvaluationAutomation
Run browser automation in Polyaxon sandboxes
Package a browser runner as a Polyaxon service, execute reviewed cases through SandboxClient, retrieve screenshots and reports, and compare agent behavior across releases.
AI AgentsSecurityAutomation
Collect run artifacts asynchronously with Polyaxon
Collect reports from several Polyaxon runs with bounded async downloads, fresh staging directories, content checks, and a receipt for every transfer.
ProductPythonAutomation
Stop expensive agent evaluation sweeps early
Use Polyaxon failure and metric early-stopping rules to bound agent evaluation sweeps while preserving complete evidence and avoiding premature quality decisions.
AI AgentsEvaluationAutomation
Tune RAG retrieval with Polyaxon experiment matrices
Compare RAG chunk sizes, retrieval depth, and model choices with Polyaxon experiment matrices, fixed evaluation inputs, and quality-aware run comparisons.
AI AgentsEvaluationAutomation
Manage many Polyaxon runs from Python
Select a run cohort, save its UUIDs for review, and apply a ProjectClient bulk action to that explicit inventory without rerunning a changing query.
ProductPythonAutomation
Submit a Polyaxon workflow from AWS Lambda
Hand a trusted operation from a short AWS Lambda invocation to Polyaxon while accounting for retries and uncertain responses.
MLOpsAWSAutomation
Trigger Polyaxon workflows from Kafka events
Connect validated Kafka events to fixed Polyaxon operations with a durable submission ledger and replay handling.
MLOpsKafkaAutomation