For the complete documentation index, see llms.txt. This page is also available as Markdown.
Inference Instance configuration
Select your model
How to select Public model?
Model catalog
If you want to infere with one of the best-known models, you can select it in our catalog of pre-charged models list.
Public custom model
If you want to select a custom model that is publicly hosted on Docker Hub, for example, click "New Deployment" and fill your docker tag in the "Public Model" text field.
How to use Private custom model?
If you want to deploy a private custom template, you'll need to create a registry. Click on “Private Model", and add your Registry informations.
To create a registry, perform the following steps:
1
Registry name
Give your registry a name consisting of lowercase Latin characters, which can be separated by dashes.
2
Location link
Provide the link to the location where your AI model is stored. We’ll use this URL to retrieve the model during deployment.
3
Username
Specify the username you use to access the storage location of your AI model.
