-
Notifications
You must be signed in to change notification settings - Fork 214
[Ready to Merge] Added Docs for AQUA Stacked Deployments #663
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
| - [Model Evaluation](evaluation-tips.md) | ||
| - [Model Registration](register-tips.md) | ||
| - [Multi Modal Inferencing](multimodal-models-tips.md) | ||
| - [Multi Model Inferencing](multimodal-models-tips.md) |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Multi Modal was the correct one. This is different from multi-model. We actually need both here.
| You'll need the latest version of ADS to create a new Aqua MultiModel deployment. Installation instructions are available [here](https://accelerated-data-science.readthedocs.io/en/latest/user_guide/cli/quickstart.html). | ||
|
|
||
| ### Description | ||
| Only fine tuned model with version `V2` is allowed to be deployed as weights in Multi Deployment. For deploying old fine tuned model weight, run the following command to convert it to version `V2` and apply the new fine tuned model OCID to the deployment creation. This command deletes the old fine tuned model by default after conversion but you can add ``--delete_model False`` to keep it instead. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Let's make a separate title for this section, something like - deploying fine-tuned models. This title will be used as a reference form the AQUA UI
|
|
||
| Note: Multi-Model deployments are identified by the tag `"aqua_multimodel": "true",` associated with them. | ||
|
|
||
| ### Edit Multi-Model Deployments |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Let's add a bit more information here, to describe a bit what can be edited and which strategy will be used for updating the deployment.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Added
Added Docs for AQUA Stacked Deployments