Get hands-on experience with 20+ free Google Cloud products and $300 in free credit for new customers.

Cloud TPU allocation time

Hi,

Can anybody help me with the average waiting time for a queued resource to be allocated and ready for use? I created an on demand TPUv4-32 queued resource in us-central2-b around 12 hours ago but the status of the resource hasn't changed from Waiting_for_resources until now. I got access to the resources through the TRC program.

Thank You

0 1 287
1 REPLY 1

Hi @Avyukth,

Welcome to Google Cloud Community!

For an on-demand TPUv4-32 in a high-demand region like us-central2-b, waiting times can vary widely based on real-time usage and available capacity. Since you’ve been waiting 12 hours with the status still at "Waiting_for_resources", it probably means there's a lot of demand right now, or there just aren’t many resources available in that zone.

Based on this documentation, when you request for queued resources, your request goes into a queue managed by the Cloud TPU service. Once the resource you need is available, it gets assigned to your Google Cloud project for your exclusive use. It’ll stay assigned to you unless you delete it or it gets preempted.

WAITING_FOR_RESOURCES - The request has passed initial validation and has been added to the queue. It remains in this state until there are sufficient free resources to begin provisioning your request or the allocation interval elapses. When demand is high, not all requests can be immediately provisioned. If you need more reliable obtainability of TPUs, consider purchasing a reservation.

Google Cloud also implements quotas to promote fairness and manage resource availability, preventing sudden usage spikes. A quota limits the amount of a specific Google Cloud resource your project can use, helping you to effectively oversee your own resource consumption within Google Cloud. This document lists the quotas that apply to Cloud TPU. For information about Cloud TPU pricing, see Cloud TPU pricing.

You can also refer to these documentations, which might help for future reference.


If you have any more concerns or questions, you may reach out to Google Cloud Support for assistance.