Dialogflow CX - Search and Conversation AI

[seancutler6]

Hello,

I am trying Search and Conversation(former Gen App Builder) with dialogflow cx to create a chatbot. I uploaded a datatstore with unstructured data. 

here are my questions:

1. In Agent Setting > ML > Generative AI > Generative AI fallback, is this where you set the prompt?

2. Where do you set the temperature?

3. Still in the same menu: What is the data store prompt for?

4. If you set the prompt here, what if you go to Edit Data Stores > Generators > and then add a generator? 

I am trying to see if how to achieve something similar that it has from Azure side: https://www.youtube.com/watch?v=tFJNasjGM3E&ab_channel=IntroductiontoMachineLearningandDataScience.   skip to 5:23

[xavidop]

Let me reply to your questions:

1. In Agent Setting > ML > Generative AI > Generative AI fallback, is this where you set the prompt? -> that is the prompt for the no-match event. You can enable generative fallback on no-match event handlers used in flows, pages, or during parameter filling. Check this: https://cloud.google.com/dialogflow/cx/docs/concept/generative-fallback

2. Where do you set the temperature? -> You have to use Generators to set those values. Check this: https://cloud.google.com/dialogflow/cx/docs/concept/generators

3. Still in the same menu: What is the data store prompt for? -> not sure about this question

4. If you set the prompt here, what if you go to Edit Data Stores > Generators > and then add a generator? -> 

A Generator allows you to make a call to an LLM natively from Dialogflow CX without needing to create your own external webhook. You can configure the generator to do anything you would normally ask an LLM to do.

I would highly recommend taking a look at the Gen AI documentation on the Dialogflow CX website: https://cloud.google.com/dialogflow/cx/docs/concept/data-store-agent

Looking forward to hearing from you. If you can provide screenshots I will be more than happy to help you better!

Xavi

[seancutler6]

1. So what if I don't have any intents except for the default hello, it will automatically go to that prompt?

2. If I create a generator and set a prompt and temperature, where do I attach it?

3. This is what I meant for Data store prompt:

What does this do? Is it the default prompt similar to 1?

4. So if I want to add a prompt and temperature, I should do something like this: 

I tried this, now the answers are not even matched to what was in the data store.

In the youtube link in my post, it was as easy as uploading the data, pointing to the data store, and configuration the prompt. I read the docs but I am finding it hard understand properly.

[xavidop · Accepted solution]

Let me reply to your points:

1. So what if I don't have any intents except for the default hello, it will automatically go to that prompt? -> so you have to know the order of execution. It is like this: 1st parameters fulfillment, 2nd intent, 3d data store, 4th no match event with generative fallback

2. If I create a generator and set a prompt and temperature, where do I attach it? you can attach it in any page, in any state handler

3. This is what I meant for Data store prompt: -> this is just to give context to the prompt and have better answers

4. So if I want to add a prompt and temperature, I should do something like this? -> that is correct

[seancutler6]

Thank you!