VertexAI AI Agent API

[robertomotta]

Hi,

i created a VertexAI AI Agent from the agent builder. What i'm trying to do now is call this Agent from a nodejs application. I'm following the instructions on the following link https://cloud.google.com/dialogflow/vertex/docs/quick/api

My question is: can i send audio to be analyzed by the agent?

If that's not possible, is there any way to connect an agent to a Dialogflow CX flow?

[ruthseki]

Hi @robertomotta,

Welcome to Google Cloud Community!

Vertex AI Agents can process various customer inputs, including text and audio like from a phone or voice recording, and respond via text or synthetic speech. Agent apps leverage large language models (LLM) for creating virtual agents using natural language instructions and structured data, streamlining the creation and maintenance process. For scenarios requiring detailed control, Vertex AI can be combined with Dialogflow CX flows in a hybrid virtual agent.

Limitations include:

• No support for sending call companion SMS from the Default Welcome Intent route in the Default Start Flow.
• The Agent Builder console does not support Dialogflow CX flows.
• Agents created in the Vertex AI console require special access to open in the Dialogflow CX console.

Furthermore, here are some documents related to using Node.js that you might find useful:

• Dialogflow CX API: Node.js Client
• Search a Data Store Node.js Code Sample

I hope the above information is helpful.

[etherlauta]

Hi @ruthseki ,

I'm trying to integrate a generative agent created in Vertex AI Agent Buider with my Dialogflow CX chatbot. My goal is for the Vertex AI agent to handle the more complex conversations, while Dialogflow CX remains the entry point for simpler ones. So far, I haven't been able to find a working solution.

As you mentioned in your response, Vertex AI require special access to open in the Dialogflow CX. Where should I go to grant those permissions?

Thanks!