Influence Looker’s Roadmap and join the BI Customer Council (BICC)
Would you like to influence Google Cloud’s BI roadmap more? I’d like to invite you to join the Google Cloud BI...
Data Analytics
Want more from your data? Have questions about products like BigQuery, Dataflow, or Pub/Sub? You're in the right place. Join conversations around data warehouse modernization, streaming analytics, business intelligence, and more.
Focused on Looker? Engage with the Looker Community here.
Focused on Looker? Engage with the Looker Community here.
Forum Posts
Datastream occasionally ingests columns that are not included
I have a datastream stream that ingests data from MySQL to Google Cloud Storage. The deployment is managed by ...
Datastream missing data, no error
Hi, I have 2 datastream from the same mysql source that ingest data to bigquery and google cloud storage (acce...
How to Reduce BigQuery Costs with GA4 Streaming?
Hi everyone,I’m analyzing our GA4 data in BigQuery to understand daily user behavior. However, I’ve noticed th...
Missing data from Google Ads transfer
Similar to this topicWe have a Google Ads transfer to bring data into BigQuery. Starting August 8, we are miss...
BigQuery External Table Creation Error with Hudi using BigQuerySyncTool
Hello everyone, I'm new to Hudi, and we're using Google Cloud Dataproc to enable it. I'm trying to create an e...
Pub/Sub Disaster Recovery
Hello!I have a question on how Pub/Sub works in case of disaster recovery.As a example let say that I have all...
Issue with Pub/Sub Subscriber Connecting but Not Receiving Messages
Hello, I am facing an issue with the Google Cloud Pub/Sub subscriber in my Spring application that is hosted o...
Slots Auto Allocation
We are implementing an auto allocation of slots to our reservation during peak times. We have commitments for ...
Bigquery transfer fail with DEADLINE_EXCEEDED on the facebook ads template
Out of the blue, the Facebook ads transfer started failing with this error message. Bigquery transfer failed w...
Zeppelin Spark SQL
We have just created Dataproc on GCE (2.2.39-debian12) with Zeppelin component, we are trying to create table ...
Missing Data in BigQuery vs GA
I am pulling user data from a google analytics instance into a data visualization tool (Tableau) using a big q...
BigQuery - Create or Replace Table possible race condition when quota (concurrently) exceeded [bug?]
If you do a `create or replace table ...` when the quota has already been exceeded then as expected the table ...
How to get the old stored procedure query
Hi,I have one scheduled query and not running for long time and accidentally it got replaced by new design and...
BigQuery data random after data loading
I'm building an ETL from by using Cloud Composer/Airflow and GoogleCloudStorageToBigQueryOperator. Wether the ...
Granting Specific Permissions for BigQuery Datasets in Google Cloud
I have admin access to our company's Google Cloud account and have created two datasets in BigQuery. Now, I wo...
PubSub Tracing in Spring
Hi community,I'm trying to trace PubSub messaging across different Spring microservices. We are running two Sp...
BigQuery Data Transfer Salesforce Returning No Data to Display
I have bigquery data transfer connected with salesforce.The transfer was succeed and I can see the schema exis...
BigQuery for GA4: Intraday table not merging with the main events table
We're experiencing a critical issue with our Big Query project for GA4 data export, specifically concerning th...
Submit PySpark job on Dataproc Servless
How to submit a PySpark job on Dataproc Servless ?I need to submit not just a single Python file, but an entir...
Dataform - Custom Service Account Billing Issue Across Multiple Projects
Hello,I am currently using Google Cloud Dataform and would like to run workflows with different custom Service...
Can not create Looker (Google Cloud core) instance
I have been trying to create a Looker (Google Cloud core) instance, but under the edition section, it showed t...
INFORMATION_SCHEMA.RECOMMENDATIONS_BY_ORGANIZATION
Our FIM Group has these roles at the ORG level but we cannot see any recommendations from the view -- `region-...
Query and Explore BigQuery from VSCode
I recently built a VSCode extension for BigQuery as I got bored of hopping into the console every time I neede...
Best Practices for Dead Letter Topic originating from a One Topic - Many Subs?
Hi Google Cloud Community,I've been working with Pub/Sub for a few months now and enjoying how straightforward...
How to programmatically get the sizes of BigQuery tables
Hello everybody,I need to programmatically obtain the size in bytes of the tables contained in a particular da...
Looker: Couldn’t send scheduled email:
Hello the community,Since few days, I have this message:Couldn’t send scheduled email: "name of the report" Da...
dynamic schema evaulavation in biglake ICERG table
hi Team, as per the iceberg documentation the product will supports dynamic schema evaluvation. we are looking...
GA4 -> Bigquery Export Bug
GA4-Export intraday-Table had complete data, but the batch load of that day only includes partially that data....
Can we resolve bigquery API memory limit issues with getting more slots?
Hi, I am currently extracting my GA4 data from bigquery using bigquery APIs. As the GA4 daily hits goes over 2...
Bigquery Data transfer from Facebook API started to fail
Is anyone getting the same error?From last Friday the Facebook API started to fail { insertId: "1mliuo3dxxx" j...
Articles from Product Experts and Googlers
How to build AI agents with long-term memory using Vertex AI Memory Bank & ADK
Is your AI agent suffering from amnesia? Don't let your users get stuck in a conversational loop. It's time to stop relying on clunky, expensive context windows that lead to "context rot." This guide introduces the Vertex AI Agent Engine Memory Bank. Learn how to build agents that remember and recall information across conversations. We'll show you how to generate, store, and retrieve memories, creating an enhanced user experience. Ready to build agents that truly connect? Let's get started.
Protect your LLM applications with Google Cloud Services
Generative AI offers immense power, but with it comes significant risk. This article discuss how to protect your LLM applications from prompt injection, data leakage, and other threats using a multi-layered security approach with Google Cloud services like Natural Language API, Model Armor, and vector databases.
Evaluating success in a multi-agent system: Why trajectory assessment and handoffs matters
Your AI agents are only as good as their ability to collaborate. As we move from single agents using tools to multi-agent ecosystems, our methods for evaluating success must evolve. Learn why trajectory and handoffs matter more than ever.
