Google Big Query - retriable error reached max retries

[juddjubz88]

When trying to run a specific job in our DataForm environment (GCP), the following error is stated:
"retriable error reached max retries. Please try execution again later. If error persists please contact support"

What is causing this issue and how do we look to resolve the issue?

We have tried waiting 24 hours to re-run the job, but we consistently get the same message. Havent been able to find any documentation regarding this error or how to solve it.

[NorieRam]

Hi @juddjubz88,

Welcome to Google Cloud Community!

It seems like you're encountering a persistent "retriable error reached max retries" error with a specific job in your Dataform environment in Google Cloud Platform.

The "Retriable Error" means BigQuery faced a temporary issue, like network interruptions. "Reached Max Retries" indicates all retry attempts failed, pointing to a more persistent problem requiring further investigation.

You may be encountering query-related issues. Here’s a breakdown of potential causes for this error and how to investigate them:

• Long-running or Complex Queries: These can lead to transient errors due to their complexity and execution time. Optimizing the queries by breaking them into smaller parts and analyzing the execution plan can help.
• Concurrent Queries: Running too many queries at once can cause resource conflicts. Checking your BigQuery quotas and managing query priorities may be necessary.
• Data Size/Location: Large datasets or data spread across different regions can trigger errors. Implementing partitioning and clustering can enhance data access and performance.

If nothing else works, contact Google Cloud support. They can investigate further using more information than you have.

I hope the above information is helpful.