Influence Looker’s Roadmap and join the BI Customer Council (BICC)
Would you like to influence Google Cloud’s BI roadmap more? I’d like to invite you to join the Google Cloud BI...
Data Analytics
Want more from your data? Have questions about products like BigQuery, Dataflow, or Pub/Sub? You're in the right place. Join conversations around data warehouse modernization, streaming analytics, business intelligence, and more.
Focused on Looker? Engage with the Looker Community here.
Focused on Looker? Engage with the Looker Community here.
Forum Posts
BIGQUERRY TO ON-PREM MSQL
Hello Team,am trying to set up a data transfer job from big-querry to on-prem msql db,but getting attached err...
Composer pipeline to upload files from Google BigQuery to an S3 bucket
I have an s3 bucket (amazon) and I want to write a composer pipeline to upload csv files into the S3 bucket on...
Connect my mysql database with airflow composer
I have a airflow implementation that running in composer. I establish the database connection using airflow ui...
CDC with Dataflow into BigQuery: Storage Write API doesn't respect Primary Key
I have a BigQuery table created using the following DDL:CREATE TABLE mytable AS ( id STRING, source STRING, PR...
How to trigger a data quality in dataplex after a dag succes
Hi teamI have a question regarding data quality rules. All my data quality rules are in YAML files, which are ...
Fetch Dataplex/Datacatalog Glossary Term Description By API
Hello all,Is there any way to fetch Dataplex (previously Datacatalog) Glossary term description by using API (...
Schema Modeling & SQL Migration Tools for BigQuery
Hi,I'm working with BigQuery and managing around 50 tables, along with multiple routines, scheduled jobs, and ...
Bigquery Data Transfer from Salesforce Internal Errors
I have recently encountered the following errors:Transfer run failed due to internal errors. Please try again ...
Log operations "save results" in BigQuery
Good afternoon, inside the company we want to log the click of the "Save Results" button from the browser UI t...
Location error on BigQuery
I've been using BQ fine for months, but today I tried to save the table from a SQL query in one of my existing...
Analytics not shown in Biqguery
Hello, My analytics event exports have been broken since 2024. I've contacted the Firebase & Analytics team, a...
Unwanted parsing when editing or adding fields of type text in the API
Hi I think there is an issue with the REST API. I am trying to use Edit or Add actions to push fields that I h...
Are BigQuery rows guaranteed to be available to Read API in the same order they were written?
Lets say I create a table with a TIMESTAMP column whose default value set to CURRENT_TIMESTAMP().I then keep i...
Issue with Dataform Variable 'undefined' During Single SQLX Execution
Hi everyone,I'm back here seeking some help!I've created my Dataform in BigQuery, which is supposed to be call...
Alerting or a Dashboard on long running query/jobs in big query
I would like setup and alert for long running queries/jobs lets if running beyond a threshold of 10 minutes. H...
PosgreSQL to BigQuery Connection
I can't seem to connect the PostgreSQL source to BigQuery using Data Transfer Service and/or Data StreamI alre...
Cost Breakdown of a Dataset to tables
Hey, We have billing reporting enabled GCP and all the detailed costs goes to BQ Table. I was analysing the ta...
Dataproc Pyspark job unable to import Google Secret Manager Library
I'm trying to set up a Dataproc workflow where I extract data from one API and load it into BigQuery, but in o...
Aspect and Tags in Dataplex Catalog
please explain the key differences between using Aspects , Aspect Types and Tags , Tags Template in Dataplex C...
BigQuery Google Ads Data Transfer - Conversion Data Discrepancies
Certain tables in our BigQuery data transfer for Google Ads exactly match the conversion data reported in the ...
GA4 Data Not Retained for More Than 60 Days
We have a GA4 export link to BigQuery since 10th of December.However, we have only data for the last 60 days.W...
Issue in Implement Datastream and Dataflow for analytics
I was adding a new source in Datastream whose base db is in Postgres I’ve setup the pipeline where the destina...
Dataplex Business Glossary automatic mapping
Hello, I've been trying to find a solution to automatic mapping of terms in Dataplex Business Glossary. I want...
PII + Dataform in BigQuery – Anyone make this work securely?
Trying to leverage BigQuery Data Protection features (policy tags, dynamic masking) with Dataform, but hitting...
Setting to increase GCP Pub/Sub subscription send throughput
I am trying to figure out the source of latency in my application as I am seeing a number of un-acked messages...
Looker Studio with BigQuery data source does not show data, what permissions should it have?
Hi everybodyI have a Looker studio dashboard, with BigQuery data source.Dashboard sharing link settings is Pub...
Unable to Push to Bitbucket from Dataform via SSH
Hello,I am currently using Google Cloud Dataform to manage a Bitbucket repository via SSH.While SSH authentica...
Issue with Missing Tables During Google Ads Data Backfill in BigQuery
Hello,We are currently extracting Google Ads data into BigQuery. However, we encountered errors on certain sch...
BigQuery 400 Error - If default_project ID is set, it must be equal to default_dataset's project ID
Hello,I have been using Simba JDBC version 1.5.0 to connect to BigQuery. From March 27th of this year (2025), ...
BigQuery Storage Read select columns from sub-records typed ARRAY<STRUCT<...>>
I am using the BigQuery Read API and have a question on using SelectedFields.My data is of the shape {message_...
Articles from Product Experts and Googlers
A developer's guide for building with Anthropic’s Claude 4 models on Vertex AI
We recently announced the general availability of two new models from the latest generation of Anthropic’s Claude model family on Vertex AI: Claude Opus 4 and Claude Sonnet 4. In this blog, we’ll guide you through building with the new Claude 4 models on Vertex AI.
Introducing DeepSeek R1 Model-as-a-service on Vertex AI Model Garden
Deploying Deepseek-R1-0528, a 671B parameters model, typically necessitates at least 8x H200 GPUs for a single API request. Such extensive resources are not accessible to everyone.To make Deepseek R1 more accessible to developers, we're excited to announce that DeepSeek R1 is now available as a fully managed API on Vertex AI in Preview.
Untangle the API maze with Apigee API Hub
Mirror mirror on the wall, What do I do with my API sprawl, Where can I see them all, How to make sure they listen to my call, And to ensure their compliance doesn’t fall. API Hub is the one to rule them all!
