Dialogflow CX how to change the detected language?

[ilabs_support]

Hello everyone,

I want to ask for Dialogflow CX. I have create a voicebot it can speak Chinese by using Google TTS. When I respond in Chinese, it cannot recongize it as Chinese and somehow try to use English instead.

When I test the bot in "Test Agent" in Dialogflow CX, it is normal that it can accepted my Chinese input and provided correct response. In the conversation history, the channel is text and it shown "zh-hk".

When I call in by phone, it can speak the Chinese announcement but cannot recognize my Chinese speaking. In the conversation history, the channel is Audio and it shown "en-US".

How can I set the Audio channel which also use "zh-hk", or other setting I missed out?

Hope someone can help me.

Thanks.

[MJane · Accepted solution]

Hi @ilabs_support, 

Welcome to Google Cloud Community!

It seems like Dialogflow CX isn't recognizing your Chinese speech correctly when using the phone channel and is defaulting to English. This could be because of a language or setting mismatch in the audio input.

Here are possible workarounds that might help you address this issue:

1. Enable Multilingual Support - Dialogflow CX has built-in support for multiple languages. Make sure you've enabled Chinese (zh-HK) as a supported language in your agent.
2. Set the Language for Text-to-Speech (TTS) - Ensure Text-to-Speech (TTS) is set to use the Chinese language (zh-HK), so the bot speaks in Chinese.
3. Configure Language in Your Telephony Platform - When you are using a third-party telephony service , make sure the speech recognition and language settings in that platform are also set to zh-HK.
4. Test Again -  Test your bot with real Chinese audio input to ensure it's working correctly.
5. Improve Audio Quality -  Ensure the audio quality from your phone calls is clear and free of background noise.

I hope the above information is helpful.

[Agentbuilderlor]

@MJane 

I saw this in the google documentation: "Language auto detection - Note: This feature is available for chat conversations only."

I have a voice agent that needs to detect from multiple languages when the person who calls in starts speaking. I am currently using Phone Gateway through google and because it can only handle one language, I've set it to Spanish. But my bot is trained on multiple languages and when I test it over text, it works fine. I just can't figure out how to get the phone feature to work. What are possible ways to make that happen? 

[ilabs_support]

Hi @MJane ,

For your suggestion of "Enable Multilingual Support", is it the same thing of "language auto detection" which stated in below link? In the document, it stated that the feature is available for chat conversations only.

https://cloud.google.com/dialogflow/cx/docs/concept/agent-multilingual#lang-detect

I resolved the above problem by changing some language parameter which passed to the Dialogflow CX. Now it can detect correct 

Thanks.

[Agentbuilderlor]

ilabs_support - What parameters did you change? because I saw this in the google documentation: "Language auto detection - Note: This feature is available for chat conversations only."

I have a voice agent that needs to detect from multiple languages when the person who calls in starts speaking. I am currently using Phone Gateway through google and because it can only handle one language, I've set it to Spanish. But my bot is trained on multiple languages and when I test it over text, it works fine. I just can't figure out how to get the phone feature to work. help? 

[ilabs_support]

For my voice bot, I am first answered the call in Webex side and then pass to DialogFlow. I can only set the language menu in Webex side and then pass the language parameter to DialogFlow.

Ideally I would like to handle the language selection menu in DialogFlow also, but I didn't get it works... This is my workaround at this moment.

[Yash-Kavaiya]

Enable Multilingual Support