Wrong TPU Quota Usage

We only used a subset of the TPU v3 Pod Quota but got the error "Quota Exhausted and exceed the limit" when applying more. We checked the quota on GCP Quota page. The Quota has been used on the page but we did not use that many TPUs. May I know how to fix this issue?

0 1 139
1 REPLY 1

Using a "subset" means that you are not utilizing the entire allocation of TPU v3 Pods that you are allowed to use. Instead, you are using fewer TPU v3 Pods or TPUs within those pods than your quota allows and you have already exhausted the allocated quota.

Double check your Cloud TPU's quota usage and ensure that you are not running more than you have been allocated. You can also request for a quota increase.