Get hands-on experience with 20+ free Google Cloud products and $300 in free credit for new customers.

[vertex ai] 503 InternalServerException Encountered when Accessing Deployed PyTorch Model on Vertex

Hi! My name is Honey.

I am serving a PyTorch model on Vertex AI. After uploading the model to the model registry as a "model.mar" file, I deployed an endpoint on Vertex AI using a GPU NVIDIA V100 and an n1-standard-16 machine.
When I try to execute the endpoint from my local machine, I get a 503 error.
The endpoint has been successfully deployed and there are no errors on the server.
However, I consistently receive a 503 "InternalServerException".

What could be the issue?

스크린샷 2023-10-10 오후 1.49.07.png

스크린샷 2023-10-10 오후 1.46.45.png

0 1 1,541
1 REPLY 1