New specification features and improved compiler

This new release introduces several new specification features:

  • Events: Events allows to run DAGs with full events support.
  • Hooks: Hooks is an extension to polyaxonfile to complete the lifecycle with a post-done logic.
  • Joins: Joins is a new abstraction that allows performing fan-in operations.

In addition to the new features, the compiler also has several new enhancements, you can check all the enhancements in this blog post.

UI

Serveral new lineage tabs

It was always possible to filter all upstream/downstream runs based on another run or all runs that are clones of a specific run. But pulling such information required doing a manual search in the comparison table.

Polyaxon UI now exposes several new lineage tabs to show:

  • Artifacts & Connections requested for a specific run:

lineage-tabs

  • All clones:

clones

  • Upstream & Downstream edge runs:

edges

Improved run’s overview page

  • Namespace and artifacts store:

namespace-artifacts-store-metadata

  • Better documentation with Readme (the markdown preview has a similar style as the run’s overview page, in both light and dark themes):

improved-docs-with-readme

improved-docs-with-readme-dark

  • IO tables with search and pagination:

io-table

  • Copying of the complete inputs and outputs as JSON objects:

io-copy

Wait time

The dashboard will show a new field wait time, this time represents all phases that come before an operation is scheduled on Kubernetes. This information is available on the overview page, and on the comparison table. Users can query and sort by the wait time similar to other meta data.

wait-time

By analyzing the wait time of runs filterd by specific queue, you should have more context to optimize and organize your queues.

Consolidated pipeline overview

We moved several aspects that provide information about the pipeline into a subsection:

  • Pipeline Concurrency
  • Children run kinds
  • Pipeline progress

pipeline-metadata

Docs

We published a new section how-tos that should feature short guides on how to use Kubernetes capabilities, as well as answer recurrent questions that we get from users. We improved and published several new sections about scheduling and how the compiler resolves information. And we are in the process of reworking several guides in the quick-start as well as introducing a new examples section with guides to understand how some features work.

Learn More about Polyaxon

This blog post just goes over a couple of features that we shipped since our last product update, there are several other features and fixes that are worth checking. To learn more about all the features, fixes, and enhancements, please visit the release notes.

Polyaxon continues to grow quickly and keeps improving and providing the simplest machine learning abstraction. We hope that these updates will improve your workflows and increase your productivity, and again, thank you for your continued feedback and support.