Hi,
I have multiple models that I want to deploy.
I created two resource pools, one for CPU and one for GPU.
Now I deployed two models to the resource pool CPU, and it is working well.
But when I try to create an endpoint and attach it to the resource pool GPU, it fails.
I tried two different models and it is still not working.
The models work if I set dedicated resources with GPU.
Here's the message I got by mail:
Error Messages: Model server exited unexpectedly.
So basically, when I hit create endpoint it keeps loading for some minutes then the error shows.