Influence Looker’s Roadmap and join the BI Customer Council (BICC)
Would you like to influence Google Cloud’s BI roadmap more? I’d like to invite you to join the Google Cloud BI...
Data Analytics
Want more from your data? Have questions about products like BigQuery, Dataflow, or Pub/Sub? You're in the right place. Join conversations around data warehouse modernization, streaming analytics, business intelligence, and more.
Focused on Looker? Engage with the Looker Community here.
Focused on Looker? Engage with the Looker Community here.
Forum Posts
Big Query can't connect to Cloud SQL after upadte from MySql 5.7 to 8.0
I have the a similar problem to this here https://www.googlecloudcommunity.com/gc/Data-Analytics/Big-Query-can...
Publish messages of Avro schema type - AvroUtilities C# library not found
I am trying to run the C# version of the Publish messages of Avro schema type and I cannot locate the AvroUtil...
Using Big Query Python Client with Custom SSL
Hi, I'm using Python to connect to fetch data from Big Query from my Corporate server. However I get the error...
SELECT list expression references column ` SubTotal ` which is neither grouped nor aggregated at [2:
Hi there can you help with thatIn the first image I copy the same to query and that works exccellentyAnd the s...
Request had invalid authentication credentials. Expected OAuth 2 access token, login cookie or other
I've encountered an issue with the listGroups function returning an error:API call to directory.groups.list fa...
How Do I Reconcile Datastream CDC Records in Bigquery
I have CDC data being ingested into BigQuery from a Postgres database using append-only mode. I cannot figure ...
How to reference an existing table with dynamic dataset suffix
Hello everyone,We are in the process of migrating all our jobs/tasks from common Scheduled Queries to Dataform...
GA4 raw export to GCS
HiMy goal is to track the events data for analysis purposes. Bigquery has a limit of capturing 1 million event...
TABLESAMPLE is not allowed with array scans at [1:613]
We are trying TABLESAMPLE function with the query below.. When trying to execute the below query we see the er...
Datastream: how to initiate backfill from new table?
I have a new table in my source PostgreSQL database. I updated the PostgreSQL publication to include the new t...
Re: Setting writeDisposition to "WRITE_TRUNCATE" when using the Storage Write API (Pending
Hi,It seems that there isn't method setWriteDisposition in Builder:Any idea what might might be amiss?Br,pekka
Bq export in parquet format
I want to export the bigquery data to GCS using bq extract command. As per the documentation, it supports the ...
Google Ads data transfer in bigquery: missing secondary goal conversions?
Hi, I noticed that no table has the secondary conversion metrics set; I can only see the primary conversions. ...
Cross Project Data Sources Lineage in Dataplex
Hi Team,I just want to understand , is it possible to create lineage using Dataplex for the BQ tables which ar...
Missing events_ table in BQ/Firebase link
Hello, dear community!I linked Firebase to BQ 9 days ago I use BigQuery streaming export.So far I have only 3 ...
DataForm - Help Needed with Reading Schema from JSON for Table Creation
Hi everyone,I’m currently working on a project where I need to create a table in GCP BigQuery. My goal is to r...
Terraform Ignore_Changes on PolicyTags in BigQuery
We are using Terraform for our IaC -- to build datasets, tables...etc. Our BigQuery Row and Column level Secur...
Saving analytics directly to BigQuery
When I read about loading data to a data warehouse, people usually mention saving the events in a cloud storag...
Setting writeDisposition to "WRITE_TRUNCATE" when using the Storage Write API (Pending mode) in Java
Hello,I'm developing a custom tool with Java for writing data to BigQuery. This tool sends data to the Storage...
writeDisposition WRITE_TRUNCATE with the bigquery storage write API
I want to use the BigQuery Storage Write API with Pending mode, but when I do BatchCommitWriteStreamsI want to...
HTTP Plugin : API Key Authentication Issue
Hi Team, I need to connect to an endpoint using an API Key.When I use the following curl command, it works per...
Dataform - dynamic name of the dataset
Hello everyone,I need help with Dataform. I have been using JS file for storing variables, one of them is data...
Best way to add query labels to a model in dataform
Hi there,As analytics engineers, we want to be able to tag our dataform queries by the layer and domain so tha...
How to use an installed public package in Dataform?
I installed this package in dataform successfullyhttps://www.npmjs.com/package/libphonenumber-jsThis is how it...
Bigquery Partitioning with Looker front end
We have a table that has streaming data of a few hundreds of MBs of data coming in everyday. This table is par...
Define list of string form query results to use in loop operation
Hi, I wanted to do this looping in dataform .sqlx file: js { const tables = [ 'table1', 'table2', 'table3' ]; ...
BigQuery - Source Platform GA4 Dimension
I am trying to figure out how to get the GA4 dimension, "source platform" in my Big Query exports. Upon my res...
Terraform Ignore_Changes on PolicyTags in BigQuery
We are using Terraform for our IaC -- to build datasets, tables...etc. Our BigQuery Row and Column level Secur...
Terraform Ignore_Changes on PolicyTags in BigQuery
We are using Terraform for our IaC -- to build datasets, tables...etc. Our BigQuery Row and Column level Secur...
Refresh Looker Studio Monthly instead of daily
Is there a way to refresh Looker Studio data from my Azure database monthly instead of daily to limit costs? D...
Articles from Product Experts and Googlers
Unlocking GenAI excellence: Why automated evaluation is your secret weapon
From powering intuitive search experiences to transforming customer service interactions, GenAI’s potential is immense. But as organizations integrate these powerful capabilities into their core operations, a critical question emerges: How do we ensure these systems consistently deliver high-quality, reliable, and responsible outcomes, truly realizing their transformative promise?
Unlocking SQL Server to Bigtable: A comprehensive guide to non-heterogeneous migration
As businesses scale, their data storage needs evolve—often demanding more flexibility, lower latency, and better cost-efficiency. While Microsoft SQL Server has long served as a reliable relational database for transactional workloads, modern data demands increasingly point toward distributed NoSQL solutions.
Cloud Composer: Managing cross-environment dependencies
This blog post explores the complexities of cross-environment dependencies in Cloud Composer and introduces a solution to streamline their management with CloudComposerDAGRunSensor.
