Influence Looker’s Roadmap and join the BI Customer Council (BICC)
Would you like to influence Google Cloud’s BI roadmap more? I’d like to invite you to join the Google Cloud BI...
Data Analytics
Want more from your data? Have questions about products like BigQuery, Dataflow, or Pub/Sub? You're in the right place. Join conversations around data warehouse modernization, streaming analytics, business intelligence, and more.
Focused on Looker? Engage with the Looker Community here.
Focused on Looker? Engage with the Looker Community here.
Forum Posts
Unwanted parsing when editing or adding fields of type text in the API
Hi I think there is an issue with the REST API. I am trying to use Edit or Add actions to push fields that I h...
Are BigQuery rows guaranteed to be available to Read API in the same order they were written?
Lets say I create a table with a TIMESTAMP column whose default value set to CURRENT_TIMESTAMP().I then keep i...
Analytics not shown in Biqguery
Hello, My analytics event exports have been broken since 2024. I've contacted the Firebase & Analytics team, a...
Issue with Dataform Variable 'undefined' During Single SQLX Execution
Hi everyone,I'm back here seeking some help!I've created my Dataform in BigQuery, which is supposed to be call...
Alerting or a Dashboard on long running query/jobs in big query
I would like setup and alert for long running queries/jobs lets if running beyond a threshold of 10 minutes. H...
PosgreSQL to BigQuery Connection
I can't seem to connect the PostgreSQL source to BigQuery using Data Transfer Service and/or Data StreamI alre...
Cost Breakdown of a Dataset to tables
Hey, We have billing reporting enabled GCP and all the detailed costs goes to BQ Table. I was analysing the ta...
Dataproc Pyspark job unable to import Google Secret Manager Library
I'm trying to set up a Dataproc workflow where I extract data from one API and load it into BigQuery, but in o...
Aspect and Tags in Dataplex Catalog
please explain the key differences between using Aspects , Aspect Types and Tags , Tags Template in Dataplex C...
BigQuery Google Ads Data Transfer - Conversion Data Discrepancies
Certain tables in our BigQuery data transfer for Google Ads exactly match the conversion data reported in the ...
GA4 Data Not Retained for More Than 60 Days
We have a GA4 export link to BigQuery since 10th of December.However, we have only data for the last 60 days.W...
Issue in Implement Datastream and Dataflow for analytics
I was adding a new source in Datastream whose base db is in Postgres I’ve setup the pipeline where the destina...
Dataplex Business Glossary automatic mapping
Hello, I've been trying to find a solution to automatic mapping of terms in Dataplex Business Glossary. I want...
PII + Dataform in BigQuery – Anyone make this work securely?
Trying to leverage BigQuery Data Protection features (policy tags, dynamic masking) with Dataform, but hitting...
Setting to increase GCP Pub/Sub subscription send throughput
I am trying to figure out the source of latency in my application as I am seeing a number of un-acked messages...
MONGODB TO BIGQUERY - Connection and Transform
I'm new to data engineering and using MongoDB, so I'd like some help, please.I have a MongoDB database that ne...
Looker Studio with BigQuery data source does not show data, what permissions should it have?
Hi everybodyI have a Looker studio dashboard, with BigQuery data source.Dashboard sharing link settings is Pub...
Unable to Push to Bitbucket from Dataform via SSH
Hello,I am currently using Google Cloud Dataform to manage a Bitbucket repository via SSH.While SSH authentica...
Issue with Missing Tables During Google Ads Data Backfill in BigQuery
Hello,We are currently extracting Google Ads data into BigQuery. However, we encountered errors on certain sch...
BigQuery 400 Error - If default_project ID is set, it must be equal to default_dataset's project ID
Hello,I have been using Simba JDBC version 1.5.0 to connect to BigQuery. From March 27th of this year (2025), ...
BigQuery Storage Read select columns from sub-records typed ARRAY<STRUCT<...>>
I am using the BigQuery Read API and have a question on using SelectedFields.My data is of the shape {message_...
Query history in BigQuery
Hello everyone,Is it possible to see the query with which a table in BigQuery was created? I’ve tried checking...
Policy Tags
Hi,Is there any way to add Policy Tags on external tables in BigQuery?
How to increase the quota in my region for cpus
Urgently i want to increase my my quota limit for CPUs to 16 or 32 but in my region i have the limit for 8 onl...
Automate a daily data collection on BigQuery
Hi everyone! I have to report the sum of my app's users on a daily basis, but I struggle to automate it.The u...
Airflow not able to parallelize tasks with .expand() - GCP Composer 3
Hello,I was developing dag pipelines in Airflow with Composer 3 set-up. Everything was working fine even with ...
bigquery - on-demand vs enterprise edition auto-scaler
We're using on-demand bigQuery model exclusively for all our projects. my observation is that in on-demand mod...
PK and FK syntax to make my script idempotent
I have below script where I create or replace tables in my pipeline. I add PK and FK constraint after the tabl...
Run DataPlex Data Quality Scan Under Custom Service Account
Hello!We are using Dataplex Data Quality Scans in our project and have encountered a limitation related to ser...
Help Needed: Missing _metadata_uuid and _metadata_lsn in BigQuery Dataset for Datastream Pipeline
Hello everyone!I could really use some assistance!I've set up a pipeline to copy data from my managed SQL (Pos...
Articles from Product Experts and Googlers
BigQuery Data Preparation with AI Agents: Smarter, faster, and code-free
Ready to unlock the secrets hidden in your product data? This tutorial demonstrates how BigQuery Data Preparation can clean and transform your raw data into actionable business intelligence, using a realistic example from the Fashion and Beauty industry.
Launched: ABAP SDK v1.10 unleashing powerful AI/ML, eventing, and storage capabilities
Supercharge your SAP systems! ABAP SDK v1.10 unlocks BigQuery AI/ML, simplified event-driven integration, Cloud Storage content repositories & access to 290+ Google Cloud APIs. See what's new.
From idea to viral video: the GenAI workflow you need
What if you could create professional-quality videos with just a fraction of the effort? This blog introduces a radical new GenAI workflow on Vertex AI, using models like Gemini, Imagen3, MusicLM and Veo2 etc to make video creation accessible to everyone.
