If you like Polyaxon, give us a star on GitHub!

Docs
Intro
  • Overview

    Get started and understand the fundamental concepts of Polyaxon


  • Quick Start

    Learn how to schedule your first experiment

  • Iterative Process

    Learn how to iterate on ML projects

  • Passing Params

    Learn how to pass values to experiments

  • Scaling Operations

    Learn how to to scale the experimentation process

  • Querying Metadata & Artifacts

    Learn how to query information about runs

  • Tensorboard

    Learn how to visualize experiments using Tensorboards

  • Automation

    Learn how to automate the ML lifecycle

  • Serving Models

    Learn how to train and deploy an ML model

  • Container Builds

    Learn how to build containers


  • Features & Architecture

    Learn about the powerful features built directly into the platform

  • Concepts

    Learn about the core concepts of the platform

References
  • Overview

    Clients, tools, and core libraries


  • Core Tools

    Tools for authoring and validating Polyaxonfiles, interacting with the platform, and querying information

  • Experimentation Tools

    Tools for processing, training, tracking, versioning, plotting, and dashboarding

  • Automation Tools

    Tools for automation using DAGs, hyperparameter tuning, parallel executions, builds, schedules, actions, hooks, and events

  • Management Tools

    Tools to manage your organization, teams, collaborators, agents, projects, runs, components, and models

Integrations
  • Overview

    All your favourite apps and tools, integrated with Polyaxon


  • Operators

    Integrations with Kubernetes Operators

  • Services

    Run your favorite services, apps, and dashboards to drive insights and share knowledge

  • Tracking & Visualizations

    Track important information about your experiments and drive insights

  • Containers

    Build containers with Polyaxon for your ML workload

  • Artifacts

    Use the artifacts store of your choice to manage logs, events, and outputs

  • Git Providers

    Use any git provider in your jobs and experiments

  • Container Registries

    Use any conatiner provider to manage your docker images

  • Data Stores

    Use cloud storage such as S3, GCS, Azure Blob Storage, volumes, NFS

  • Notifications & Alerting

    Monitor and send alerts and notifications

  • Extend your setup

    Customize your setup to fit your use-case

  • Automation

    Integration with CI/CD workflow systems

  • SSO

    Deploy with Single Sign On

Setup
  • Overview

    Setup & installation guides


  • Agent Setup

    Install Polyaxon Agent to schedule workload on your Kubernetes clusters

  • Platform Setup

    Install Polyaxon Platform on Kubernetes

  • Connections Configuration

    Configure Connections to allow your jobs and services to access secrets, registries, data stores, and protected APIs

  • Auxiliaries Configuration

    Configure the default containers injected by Polyaxon

  • Deployment Strategies

    Common strategies and best practices to deploy Polyaxon

  • CLI installation

    Polyaxon CLI installation

Resources
  • Overview

    Product roadmap, release highlights, tutorials, and guides


  • Intro & Guides

    Introduction and tutorials to get started with Polyaxon

  • FAQ

    Help center and frequently asked questions

  • Release Notes

    Release notes and highlights

  • Short Term Roadmap

    High-level visibility into the short-term direction of the product

  • Versioning

    Versioning and release cycle

  • Migrations

    Migrating guides

  • Slack Channel

    Get support, learn, and share with thousands of data-scientists & ML engineers.

  • Github Discussions

    Q&A and other community resources

  • Contributing

    Guide to contribute to Polyaxon's open-source tools

  • Blogs

    Guides, announcements, highlights

Polyaxon & Kafka

How to use Polyaxon and Kafka together

Polyaxon
+
Kafka

On this page

You might also like...

  • Airflow
    Airflow
  • Argo
    Argo
  • Github Action
    Github Action
  • Jenkins
    Jenkins
  • Tensorflow TFX
    Tensorflow TFX

About Kafka

Apache Kafka is used for building real-time data pipelines and streaming apps.

Integrations/pipelines

Version

This is the docs of the latest stable version.

Improve this page!

If you spot a typo or have a suggestion to make this page better, please make a contribution to improve the documentation.

Update this page

Have a feedback?

We do our best to make this documentation clear and user friendly, if you see anything that is incorrect or have any questions, feel free to reach out!

Send Feedback

Tired of managing your own servers?

Use Polyaxon Cloud, our managed Control Plane, and spend your time on the things that matter.

Got an issue or a feature request?

You can use our issue tracker to report bugs, issues, and create feature requests.

Looking for help or advice?

Join our community channel and ask for help.

  • Made with ♥
    Star us on Github
  • Product
    Tracking
    Orchestration
    Optimization
    Model Management
    Insights
    Collaboration
    Management
    Scalability
    Compliance
  • Why Polyaxon
    For Data Scientists
    For Team Leads
    For Architects
    For executives
  • Offering

    Polyaxon Cloud
    Polyaxon EE
    Polyaxon CE
    Polyaxon Pricing
  • Support

    Issue Tracker
    Slack Channel
    FAQ
    References
    Resources
    Feedback
    Contact Us
  • Info

    Features
    Docs
    Integrations
    Intro & Guides
    Examples
    Github
    Blog
    Jobs

Join our Newsletter

Stay up to date with the latest news from the Polyaxon community!

© 2023 - Polyaxon. All rights reserved. | Privacy | Terms