Get hands-on experience with 20+ free Google Cloud products and $300 in free credit for new customers.

Ray cluster's OSS dashboard and headnode link return 524 error

 

 

I have set up a Ray Cluster. However, when i try to view the OSS dashboard through the link on my vertex AI console, I got the 524 error page. 

t4ruixi_0-1728680642075.png

No error information was provided on that page. Can I get some help on how to resolve this issue?

In addition, when i try to connect to this cluster in the provided Enterprise Notebook, with the following code:

 

ray.init(address="vertex_ray://....")

 

I got a ray client connection timeout. It seems that some network connection setting is bad here. 

 

Solved Solved
1 3 232
1 ACCEPTED SOLUTION

I figured this out by myself. You'll need to make sure you pick a `network` during the cluster setup, and use a client in the same network to connect. It will provide you a https domain name with a Bearer token after you do a successful connection. 

This is probably due to a network firewall setup done on Google's side. 

View solution in original post

3 REPLIES 3

Hi @t4ruixi,

This usually happens if you're using a small machine node for the Ray Head node. As a workaround, it is recommended that you use at least e2-standard-16 for the Ray Head node.

Hope this helps.

Hey, @cassandramae . I used a very beefy head node actually, e2-highmem-16. I tried even beefier nodes but still got the same error. 

I figured this out by myself. You'll need to make sure you pick a `network` during the cluster setup, and use a client in the same network to connect. It will provide you a https domain name with a Bearer token after you do a successful connection. 

This is probably due to a network firewall setup done on Google's side.