Get hands-on experience with 20+ free Google Cloud products and $300 in free credit for new customers.

Triton on Vertex AI does not support multiple models?

Currently, I want to deploy a Triton server to Vertex AI endpoint. However I received this error message.

"failed to start Vertex AI service: Invalid argument - Expect the model repository contains only a single model if default model is not specified"

Is this mean that the Triton server deploy only support one model? It is different from what I have read in this document about concurrent model execution

https://cloud.google.com/vertex-ai/docs/predictions/using-nvidia-tritonScreen Shot 2022-08-25 at 21.13.18.png

2 10 2,021
10 REPLIES 10