Error 503 - Too long to process

[vibha11]

I have deployed a Llama-3 model, using huggingface one click deploy. However, when i try to access the endpoint I get error 503 which seems like the resources are not available.
I have been having this issue for the entire day and I also changed and tested in all possible regions.
Is there any solution to this issue, as it makes the entire system unstable.

[cassandramae]

Hi @vibha11,

To isolate if this is only happening to a specific model, could you try deploying a different model in the same endpoint? 503 errors usually resolve after retrying. With this, you may also try redeploying the Llama-3 model using the same endpoint and see if it works.

If the issue persists, I suggest reaching out to Google Cloud Support for further investigation and check if this could be a potential bug or project-specific issue only. 

Hope this helps.