Get hands-on experience with 20+ free Google Cloud products and $300 in free credit for new customers.

Dialogflow CX - weird response order (LLM > intents)

Currently, I'm switching to CX from ES and I'm trying to figure out how to get the best results.

What is a problem: Dialogflow answers with LLM much more frequently than in a "regular" way.
Statistically, 6/10 responses come from LLM, 3/10 come from intents in the flow, 1/10 from a route group.

It causes obvious problems: I can't use a route group to transition to other flow if question is not from current flow and I can't design the entire response process exactly as I would like, because LLM constantly breaks into conversation.

The irony is that the knowledge base that powers the LLM is identical to phrases and responses in intents that are in flows and route groups... Settings are: 0.6 threshold for intents and very high score for grounding (LLM).

  • Data store: backup of the ES bot.
    - Structure: unstructured data that consists of all intent names, training phrases and responses.
    - LLM works on it very well.
  • Intents and entities - migrated via Google's tool (Go code / GC SDK Shell)
  • Intents in flows - I added every intent from ES and just made a example answer to cut time
  • Intents in route groups - agent level, as above.

Have you ever had similar problem? Or maybe you have any ideas how to deal with it without creating webhooks?

0 5 340
5 REPLIES 5

Hi @Wojtek1 

According to the bot hierarchy response
1 - Flow with Intents and Entities
2 - LLM with Data Stores
3 - Fallback intent

So I recommend you to design your utterances properly and add into the Entities, then the LLM comes in and then the fallback goes at the end.

Thanks @Mizar but unfortunately you didn't quite understand my problem:)

If you dont want to use webhooks, define a good structure of intents and manage fallback withing LLM

What do you mean by "good structure"? I migrated all intents and entities with this tool:
https://cloud.google.com/dialogflow/cx/docs/how/migrate
It's exactly the same as my bot on ES version, which works fine.

Well Df Cx doesnt work exactly as Df ES, most of the tools for migrating fail at certain part.

Can you show me an example of a flow you have imported into df cx?