Exceeded rate limits: too many concurrent queries that use ML.GENERATE_TEXT table-valued function fo

[Rajavelu]

Hi,

I am getting below error sometimes in bigquery console.

Exceeded rate limits: too many concurrent queries that use ML.GENERATE_TEXT table-valued function for this project. For more information, see https://cloud.google.com/bigquery/docs/troubleshoot-quotas

[marckevin]

Hi @Rajavelu,

Welcome to Google Cloud Community!

The error ”Exceeded rate limits: too many concurrent queries that use ML.GENERATE_TEXT table-valued function for this project" typically happens when you exceed the allowed operations within a short timeframe.

Here are several suggestions that may help resolve the issue in addition to the provided link:

• Querying Limits: You can review this documentation on limits of querying ML.GENERATE_TEXT to check if you're already hitting the limit based on the specified requirements on your project’s Quotas and Limits.
• Implement Exponential Backoff: Reduce your request rate and increase the wait time between attempts to avoid hitting the rate limit.
• Batch Operations: Combine smaller operations into larger ones to decrease the total number of individual requests and avoid exceeding the limit.
• Optimize Queries: Optimizing queries can reduce execution time, you can check this documentation for best practices and techniques to efficiently run queries.

Was this helpful? If so, please accept this answer as “Solution”. If you need additional assistance, reply here within 2 business days and I’ll be happy to help.