Analytics in Agent Builder (Vertex AI Search)

[ahebler]

I've created a Search App in Agent Builder with Large Language Models for summarization enabled. I've connected that to a data source containing five different URLs on my website. My understanding is that this product is called: Vertex AI Search

I've integrated it on my website via the out-of-the-box embed widget provided in the dash and have had several users test it. It's populating results and is configured properly as a far as I can tell. The problem is that I'm not seeing any usage data or analytics attached to it. Here's where I'm looking:

Agent Builder > Apps > Select my search app > Click Analytics from the left sidebar.

Is there a trick to getting this feature to work?

Screenshot below:

[ibaui]

Hi @ahebler,

Welcome to Google Cloud Community!

Based on your description, the issue with your Vertex AI Search app not showing any usage data or analytics feature could be attributed to several factors. Here are some potential causes and areas to investigate:

• Data Collection Delay: Sometimes, there might be a delay in the data being collected and displayed in the analytics dashboard. Allow some time for analytics data to accumulate, especially if the app is new. Check back later to see if data appears.
• Insufficient User Interactions: If your search app hasn’t had enough user interactions (such as search queries, clicks, etc.), it may not generate sufficient data for the analytics to show meaningful results. Conduct several searches using the widget yourself to see if that generates data.
• Analytics Configuration: Ensure that analytics is enabled for your search app in the Agent Builder settings. Sometimes, features need to be explicitly turned on. You can verify this by visiting your search app settings in Agent Builder and confirming that analytics is turned on. Look for any specific configurations related to data collection.
• Embedding Issues: Verify that the embed widget is set up correctly on your website and that users are indeed interacting with it. You can test this by performing searches yourself.
• Access Permissions: Ensure that your account has the necessary permissions to view analytics. Sometimes, restricted access can lead to missing data.

For more detailed  information, you can visit the sections Introduction to Vertex AI Search and How to View Analytics for Your Search Apps.

I hope the above information is helpful.

[cfulam]

I am experiencing the same issue for my generative search app. The analytics section shows 0 results. I deployed the app to my website two days ago, and generally get about 200 searches a day.

[ahebler]

 @ibaui, thanks for the response, but none of those seem to be the culprit. I see this note in your docs:

"Metrics from the widget don't appear on the **Analytics** page."

 
So I guess if you use the widget implementation instead of the API, you don't get access to analytics? That seems counterintuitive and very limiting, but it would make sense why we're still not receiving any data. Also thanks for confirming you're seeing the same,  @cfulam 

[khiemleol1111]

We had the same problem, when we first launched the platform, we were still seeing data, but a few months ago until now, the analytics section is no longer showing data, even though I reviewed the Microsoft Clarity tracking tool, there are still users who click on the search box and query for information. Please show me how to fix this.

[luis-quissak]

hello team, i have the same issue here.. is there any trick?

[yp2]

I also have the same problem.  Implemented using the widget. 

[RicardoFM]

Hi @ahebler were you able to solve this issue? I am experiencing the same trouble  with the analytics on Vertex AI Search.

[antk]

There appears to be a difference between vertex ai search and vertex ai search for commerce.

I think the analytics dashboard here might for commerce.  Additionally, if you want to see data here, you will need to implement userEvent integration, as detailed in the docs

I am using the api and it looks like there are a few ways to record user events:

• javascript pixel
• ga4 with gtm
• direct write to api via endpoint
• tag manager

Here's a link to documentation details.

Went through all these docs and I'm still needing some clarification on what is for commerce and what is for plain old vertex search.  We went plain old vertex search because we were migrating from programmable search engine (which is what the docs told us to do), but there was no mention of vertex ai search for commerce