Hi,
I'm new to GCP and I was trying to run a LLM tuning process in Vertex AI.
I upload my data in the jsonl format in a bucket and selected it to start the tuning process. During the pipeline, I got this error:
com.google.cloud.ai.platform.common.errors.AiPlatformException: code=RESOURCE_EXHAUSTED, message=The following quota metrics exceed quota limits: aiplatform.googleapis.com/restricted_image_training_tpu_v3_pod, cause=null; Failed to create custom job.Project number: 162269030045, Job id: 8911904581961646080, Task id: -5724177380969283584, Task name: large-language-model-tuner, Task state: DRIVER_SUCCEEDED, Execution name: projects/162269030045/locations/europe-west4/metadataStores/default/executions/9317118956493817351; Failed to create external task or refresh its state. Task:Project number: 162269030045, Job id: 8911904581961646080, Task id: -5724177380969283584, Task name: large-language-model-tuner, Task state: DRIVER_SUCCEEDED, Execution name: projects/162269030045/locations/europe-west4/metadataStores/default/executions/9317118956493817351; Failed to handle the pipeline task. Task: Project number: 162269030045, Job id: 8911904581961646080, Task id: -5724177380969283584, Task name: large-language-model-tuner, Task state: DRIVER_SUCCEEDED, Execution name: projects/162269030045/locations/europe-west4/metadataStores/default/executions/9317118956493817351
So I looked online for a solution/work around to this problem. I found that some users were resolving it by updating their quotas. Then in the error message I've seen that my limit are reached for the europe-west4 (if I've understood correctly). That's what I'm trying to do right now. Do some of you guys got the same error and can give me some advice to fix it?
I look forward to hearing back from you!
Thank you so much!
LinkedIn
Twitter
