I have deployed two deep learning models on fastapi on a google cloud vm using nginx server. the server works good. now i want to add another code which uses sentence transformers. But after adding the code I get timeout error. I checked the CPU utilization, memory usage of my service but it is all okay.
I am not able to pin point the issue. What can I do to rectify this issue.
Thank
Hi @Vedant9307 , based on your description of the issue, it appears that the Compute Engine VM is running fine & not overloaded with other processes. Given that the other two deployments (i.e., the two deep learning models) appear to be running fine, there doesn't seem to be a problem with the VM. Still, just to make sure, could you try stopping & re-starting the VM? Also, if it isn't too much trouble, can you try deploying the sentence-transformer on a different VM? This might help to narrow down the possible problem areas.