Vertex AI Conversational Agent

Gargeya

Hi Everyone,

I’ve created an agent in Vertex AI Conversational Agent using the “Build Your Own” (not chat) option. I’ve also connected it to a BigQuery dataset via the Data Store tool. I’ve defined instructions in the Playbook and confirmed that the agent is linked to the data store correctly.

However, when I test the agent, it doesn’t return any responses based on the structured data (from BigQuery or a CSV in Cloud Storage). The agent keeps responding with “I don’t have that information” or similar fallback replies.

I’m unsure how to proceed—structured data appears to be set up correctly, but the agent isn’t retrieving or referencing it during conversation. I feel stuck at this point and would really appreciate any guidance, troubleshooting tips, or best practices to resolve this.

Thanks in advance!

MarvinLlamas

Hi @Gargeya,

Welcome to the Google Cloud Community!

It looks like you are encountering an issue where your Vertex AI Conversational Agent, despite being correctly linked to structured data via BigQuery or CSV, isn’t retrieving or referencing that information during your interactions, leading to fallback responses like “I don’t have that information.”

Here are the potential ways that might help with your use case:

Structured Data Store Type: Make sure your Data Store is clearly set up as a 'Structured data' source when connecting to BigQuery or CSV files, as this helps your agent recognize and use the data effectively.
Playbook Instructions: You want to make sure your Playbook instructions provide clear, actionable guidance, telling your agent exactly when to use the data store and how to reference its schema so it can respond with relevant, structured information.
Confirm Agent-Data Store Linkage: You may want to double-check that your Data Store is correctly linked to your agent and ensure that the "Search and retrieve information from your data stores" Generative AI capability is enabled both are essential for helping your agent respond reliably with structured data during conversations.
Permissions: Make sure your service account is granted the BigQuery Data Viewer or Storage Object Viewer role, as these permissions are essential for retrieving data from your connected sources.

In addition, you may want to check this lab that walks through Vertex AI agent setup and data store integration, it’s a useful way to confirm your configuration and make sure no key steps were overlooked.

Was this helpful? If so, please accept this answer as “Solution”. If you need additional assistance, reply here within 2 business days and I’ll be happy to help.