Vertex AI datastore size doesn't change after purge

[JoVa]

Hi folks,

I have a datastore where i indexed a lot of documents.
Good for 200Gb of indexed data.

Because this an immense cost, I purged the whole datastore.
But no, even after days, it still says it has 200Gb + of indexed data. And i still pay for that.

Is this normal it takes that long?

[ibaui]

Hi @JoVa,

Welcome to Google Cloud Community!

Purging data is a long-running operation that can indeed take some time, especially if the data store contains a large volume of data. The operation is asynchronous, meaning it doesn't happen instantly and can take hours or even longer to complete, depending on the number of documents being deleted.

If the data store size hasn't updated after several days, it might be worth checking the following:

• Purge Completion: Ensure the purge operation is fully completed. You can use the methods outlined in this documentation (e.g., operations.get) to check if your purge operation has completed successfully. Sometimes, partial purges can leave residual data.
• If the issue persists, and the purge still isn't reflected correctly, I suggest contacting Google Cloud Support. They can provide further insights to determine whether the behavior you've encountered is a known issue or specific to your project, and they can examine the internal processes as well.

Was this helpful? If so, please accept this answer as “Solution”. If you need additional assistance, reply here within 2 business days and I’ll be happy to help.