ChangelogRelease notes for v2.20

V2.20.4

Commercial

  • Fix: Scheduled reconciliation of stuck runs no longer fails with a SchedulingError.

V2.20.3

Core

  • Enhancement: Add reconciliation for runs that are stuck when a worker becomes unavailable while they are being scheduled.
  • Enhancement: Optimize project lists APIs.

UI

  • Fix: Contributor lists on projects, versions, agents and runs are labelled "Contributors" instead of "Active users".

Commercial

  • Enhancement: Raise the default run rate limit to 400 requests per minute.
  • Fix: UI no longer fails to load when many users connect from the same IP address.

V2.20.2

CLI

  • Enhancement: Improve default .polyaxonignore to prevent uploading virtual environments, node_modules, and test, coverage and linter caches.

Core

  • Enhancement: Refresh rolling stats after runs leave the 30-day window.
  • Fix: Runs no longer lose the summaries and latest values of all their metrics when one metric file is damaged.
  • Fix: Project stats now update after performing multi-run actions: delete, archive or restore, move runs or versions to another project, or delete a version.

UI

  • Fix: Runs table no longer shows a full-height green bar at the left edge of the page when 3 or more filters are applied.

Commercial

  • Enhancement: Reduce database load from organization stats.
  • Enhancement: Reduce database load from queue and agent stats.
  • Enhancement: Recalculate stats when entities have new activity.

V2.20.1

Core

  • Enhancement: Faster lineage saving for runs that log many metrics.
  • Fix: API no longer returns errors while Redis is temporarily unavailable.
  • Fix: Issue where lineage data could be lost when two updates to the same artifact happened at the same time.

V2.20.0

CLI

  • New: Add a root dag section to define DAGs without run.kind: dag.
  • Breaking: Drop support for Python 3.8. polyaxon, traceml and hypertune now require Python 3.9 or later.
  • Enhancement: Replace pytz with the standard library's zoneinfo.
  • Fix: Failed API calls no longer print the client config, which included the auth token. The error shows the API host; with -v or POLYAXON_DEBUG it also prints the full config with the token masked. -v no longer prints raw HTTP request headers, which included the token.

Core

  • New: Add securityContext.applyToRuns to the Helm charts to use the chart's security context as the default for run pods. It's off by default, and a run's or preset's environment.securityContext still wins. Remove the unused POLYAXON_SECURITY_CONTEXT_USER and POLYAXON_SECURITY_CONTEXT_GROUP variables.
  • Fix: Remove deleted files from volume claim and host path artifact stores. The sidecar's delete failed silently, so the files stayed in the store and came back when the run resumed.
  • Fix: Regression in the agent created cleaner pods without their volumes, volume mounts, envFrom, valueFrom env vars and security context. Deleting a run left its artifacts in the store, and the cleaner still reported success.
  • Fix: plugins.ssh now fails with a clear message when the container doesn't have permissions to init the script.
  • Fix: Agent crashed and restarted with up to 5 minutes of backoff when a state request failed, for example during an API restart or when rate limited. It now waits for the next check.
  • Fix: PQL datetime filters (<, <=, >, >= and .. on created_at, updated_at, started_at and finished_at) now parse values in the platform timezone. Comparisons no longer log a naive datetime RuntimeWarning on every query, and on deployments with a non-UTC timezone, .. ranges are no longer shifted by a few minutes.

Operator

  • Fix: Cap service activity probe responses at 64 KiB and stop following redirects. A service could return a response large enough to run the operator out of memory. A probe that returns a redirect now fails, and the service is not culled.

Commercial

  • Enhancement: Improve run throttle scope.
  • Enhancement: Add gateway.cache.enabled to the Helm chart to share API rate-limit counters across API workers and replicas through Redis. It's off by default.
  • Enhancement: Add gateway.throttle.rates to the Helm chart to set API rate limits per scope.
  • Enhancement: hubRef, modelRef, artifactRef and lineageRef now resolve only from projects the run's user can read. A project restricted to teams or users can no longer be read through a run in another project of the same organization; a denied reference fails like a missing one.
  • Fix: Regression in console and file email backends, they write links as plain text again.