You can use one or multiple buckets on Minio to access data directly on your machine learning experiments and jobs.
Before using Minio, you need to deploy it and create a bucket (or several) to host your data.
There are different ways to deploy Minio on Kubernetes, if you want to deploy Minio using the Helm Chart, you need to:
- Add Minio's repo:
helm install stable/minio
- Deploy Minio's chart:
helm install plx-minio minio/minio --namespace=polyaxon
You can also deploy with different configuration by using a config.yaml or passing the values as params, e.g.
You should create a bucket (e.g. plx-storage) where you will host your data.
In order to use the buckets with Polyaxon, you can follow the S3 DataStore integration.
Note: When Minio is installed via Helm with default values, it uses the following hard-wired default credentials, which you will use to login to the UI and setup access to Polyaxon:
AccessKey: myaccesskey SecretKey: mysecretkey
This means that the default secret keys should be:
- AWS_ENDPOINT_URL: "http://plx-minio:9000"
- AWS_ACCESS_KEY_ID: "myaccesskey",
- AWS_SECRET_ACCESS_KEY: "mysecretkey"