How to automatically start index a website Datastore through API?

[aninhalacerda]

I'm using a website Datastore (no advanced index) with Vertex Search AI and want to be able to develop my own scheduler to reindex from time to time.

I looked into Google Datastore API (both Data and Admin API and it seems that only Cloud Storage is supported.

https://cloud.google.com/datastore/docs/reference/data/rest

Could not find in Discovery Engine API reference as well.

Is it possible?

[amitagarg22]

I am also having similar kind of requirment , if anybody can help. 
I want to my datastore to be updated automatically when new documents are uploaded in the storage and want vertex AI seacrh to be upto date automatically.

Anybody have any information ? 

[piyush_garg]

Hi @amitagarg22 

yes we can automate the process that will directly import the documents to data store once it received in GCS you just need to make cloud function which will attached to your bucket once bucket receive the file trigger the cloud function which have the code of import data to existing data store

i recently worked on the same use case

please refer this module in this module you can also delete the documents

https://github.com/googleapis/google-cloud-node/blob/main/packages/google-cloud-discoveryengine/samp...

it will definitely help you

Best

Piyush Garg

[amitagarg22]

TCS Confidential

Thank you Piyush for replying.
But will approach work when I upload lots of document in bucket say 10000 in one go. Not sure if we need use workflows or cloudRun or anything else to handle this.

Regards
Amita Garg
AI.Cloud GTM
Tata Consultancy Services

=====-----=====-----=====
Notice: The information contained in this e-mail
message and/or attachments to it may contain
confidential or privileged information. If you are
not the intended recipient, any dissemination, use,
review, distribution, printing or copying of the
information contained in this e-mail message
and/or attachments to it are strictly prohibited. If
you have received this communication in error,
please notify us by reply e-mail or telephone and
immediately and permanently delete the message
and any attachments. Thank you

[aninhalacerda]

Thank you for the inputs. My case is with the website Data store and how can I set a schduler to reindex from time to time?

Not using cloud storage yet, it's a public website. I want  to be able to start that index via API.