Automatic Synchronisation of Data Store with Storage Bucket

[patientnut]

I've set up a data store in Agent Builder and imported data from a storage bucket. Is there a way to automatically synchronise the data store so that it updates whenever content is added or removed from the bucket?

[NorieRam · Accepted solution]

Hi @patientnut,

Welcome to Google Cloud Community!

Currently, Agent Builder's data store doesn't offer automatic synchronization with Cloud Storage. Data imports are one-time operations. To ensure data store currency, the development of a custom solution is required.

One approach is to use Cloud Functions triggered by changes in your storage bucket. The function would then update the data store with the new or deleted data using the Agent Builder API.

Alternatively, schedule a recurring Cloud Function or other scheduled task to periodically import the latest data from the bucket into the data store, effectively overwriting the existing data. This approach is simpler but less real-time.

Was this helpful? If so, please accept this answer as “Solution”. If you need additional assistance, reply here within 2 business days and I’ll be happy to help.