Get hands-on experience with 20+ free Google Cloud products and $300 in free credit for new customers.

Vertex AI Search with Follow up

Hello,

I am currently working ona project where i need to create a basic agent(search + followup) which can answer user's questions based on a GCS datastore(which has few pdfs).

The problem i am facing is that after it gets the answer for an initial question, if the follow-up message is something general like: "make this shorter" or "explain in simple terms", then it fails and gives a fallback response like: "please try re-phrasing your query". Also, from the response, i can makeout that it is trying to search the datastore for content similar to the follow-up message but obviously fails.

Is there a way where i could enable simple follow-ups once the main question has been answered?

0 1 58
1 REPLY 1

Hi @hardikr23,

Welcome to the Google Cloud Community!

You need to store the details of the previous exchange, including the last question asked and the corresponding answer provided.Then, for a new user message, you need a mechanism to decide if it's a follow-up or a new question. In addition, you might find it helpful to check this documentation to address your issue. It provides information for enabling simple follow-ups in Vertex AI Search. 

Was this helpful? If so, please accept this answer as “Solution”. If you need additional assistance, reply here within 2 business days and I’ll be happy to help.