There are already 3 running ImportRagFiles operations in this project. The max limit is 3.

[Giddeon]

Hello!
I'm new to vertex and I'm trying to import files from my gcs to Vertex AI RAG using a python SDK

For some reason when I try to run an import I receive the following error:  `'Failed in importing the RagFiles due to: ', FailedPrecondition('There are already 3 running ImportRagFiles operations in this project. The max limit is 3.')`
It is very unclear to me why am I receiving it since there's absolutely nothing going on in my cloud and no other service uses RAG or imports files there.
Is there a way to prevent this error or find which services are doing this?

[marckevin]

Hi @Giddeon,

Welcome to Google Cloud Community!

The error 'Failed in importing the RagFiles due to: ', FailedPrecondition('There are already 3 running ImportRagFiles operations in this project. The max limit is 3.')` usually suggest you’re already hitting the max limit of 3 concurrent import requests that Vertex AI's RAG functionality imposes.

Here are possible reasons and suggestions that you can try:

• Review your Python SDK that triggers the ImportRagFiles operation. Make sure you're not accidentally starting multiple imports at the same time.
• Investigate any automated processes that may be importing RAG files without your knowledge, such as scheduled tasks, Cloud Functions, or other similar processes.
• Ensure your Vertex AI service account has a necessary permission to read from your GCS bucket like Vertex AI User and Storage Object Viewer.
• Consider using Exponential Backoff if applicable. This will increase the wait time between attempts, giving your application a chance to pause and retry the operation after a certain delay.
• Audit Logging: To further analyze your issue, you may examine and review logs related to RAG imports which can provide more insights into the error.

If the issue persists, I recommend reaching out to Google Cloud Support for further assistance, as they can provide insights into whether this behavior is specific to your project

Was this helpful? If so, please accept this answer as “Solution”. If you need additional assistance, reply here within 2 business days and I’ll be happy to help.

[Giddeon]

Hi @marckevin !
Thanks for looking into my problem!

After a deeper investigation I found out that I really have 3 operations which never end and which I can't cancel for some reason.
I was able to find them by calling GET https://us-central1-aiplatform.googleapis.com/v1/projects/<PROJECT_ID>/locations/<LOCATION>/operations?filter=done=false

I tried to cancel them with POST https://us-central1-aiplatform.googleapis.com/v1/projects/<PROJECT_ID>/locations/<LOCATION>/operations/ragCorpora/<CORPORA_ID>/operations/<OPERATION_ID>:cancel

but I receive the following error: `Operation ..... is not cancellable`
So I neither can cancel it nor it ends by itself which blocks me from work.
Any ideas?

[Giddeon]

Hi @marckevin !
Thanks for looking into my problem!

After a deeper investigation I found out that I really have 3 operations which never end and which I can't cancel for some reason.
I was able to find them by calling GET https://us-central1-aiplatform.googleapis.com/v1/projects/<PROJECT_ID>/locations/<LOCATION>/operations?filter=done=false

I tried to cancel them with POST https://us-central1-aiplatform.googleapis.com/v1/projects/<PROJECT_ID>/locations/<LOCATION>/operations/ragCorpora/<CORPORA_ID>/operations/<OPERATION_ID>:cancel

but I receive the following error: `Operation ..... is not cancellable`
So I neither can cancel it nor it ends by itself which blocks me from work.
Any ideas?