This website uses Cookies. Click Accept to agree to our website's cookie use as described in our Privacy Policy. Click Preferences to customize your cookie settings.
Accept
Reject
Preferences
Log in to ask a question
Get hands-on experience with 20+ free Google Cloud products and $300 in free credit for new customers.
Log in to ask a question

Concern regarding Cloud Run server instance creation delays

Posted on 02-21-2024 12:10 AM
Accredian
Bronze 1
Bronze 1
Reply posted on --/--/---- --:-- AM

Hello,

For the past month, I have been observing the behavior of the Cloud Run serverless scalability. When the total number of API requests exceeds the number of concurrent requests, Cloud Run takes too much time to create a new instance. Consequently, some API requests timeout, and there is a delay in redirecting the exceeded requests to the new instance. Although my API request timeout is set to 30 seconds, the API continues to return a 504 upstream timeout error. Please let me know if there are any settings missing in the Cloud Run configuration. My maximum concurrency request limit is set to 8, and I am running Node.js code on my server, which is single-threaded.

I appreciate your assistance in advance.

Thank you.

1 2 329
Topic Labels
2 REPLIES 2

Posted on --/--/---- --:-- AM
christianpaula
Staff
Reply posted on --/--/---- --:-- AM

Hi @Accredian,

Welcome to Google Cloud Community!

These might help you:

  • Cold Starts: Increase API timeout or enable pre-warmed instances.
  • Resource Limits: Monitor resource usage in Cloud Monitoring and consider changing region if needed.
  • Single-threaded Node.js: Explore async/await, frameworks like Express.js, or horizontal scaling.
  • Additional Tips: Check logs and consider Cloud Functions for simple, stateless applications
0 Likes

Posted on --/--/---- --:-- AM
udurrani
Bronze 2
Bronze 2
Reply posted on --/--/---- --:-- AM

Hi @Accredian, did you figure out the optimal options for fast creation of instances? 

0 Likes