Influence Looker’s Roadmap and join the BI Customer Council (BICC)
Would you like to influence Google Cloud’s BI roadmap more? I’d like to invite you to join the Google Cloud BI...
Data Analytics
Want more from your data? Have questions about products like BigQuery, Dataflow, or Pub/Sub? You're in the right place. Join conversations around data warehouse modernization, streaming analytics, business intelligence, and more.
Focused on Looker? Engage with the Looker Community here.
Focused on Looker? Engage with the Looker Community here.
Forum Posts
Creating a Sink for BigQuery Audit Logs Across Organizations or Projects
Hello!I'm currently working on setting up a sink for BigQuery Audit Logs, and I'm wondering if it's possible t...
Dataplex attribute store on entities from bigquery
Hi all,I'm trying to attach an Attribute Store to a table in BigQuery that already existed before I created a ...
Spring based Java API/Library for GCP Bigquery Storage Write API
Hi @ ,Earlier I was using Bigquery InsertAll() method for streaming data to BQ using Spring based library/apis...
Emmanuel Katto : How to Prevent a DAG from Running Automatically on Startup in Airflow?
Hello everyone,I'm Emmanuel Katto, We’re using Airflow in a daily pipeline, and everything runs in the morning...
Querying public google_ads_transparency_center table doesn't show all the needed data.
I'm having an issue querying table `bigquery-public-data.google_ads_transparency_center.creative_stats` for a ...
Streaming Buffer in BigQuery Taking Too Long to Flush After InsertAll Operation
Hi everyone,I’m experiencing an issue with the streaming buffer in BigQuery. I am using the Java SDK (Java 8 )...
Is there a way to apply labels to a BigQuery query issued from a Dataflow job?
We are running Apache Beam on Google CLoud Dataflow. One of our jobs SELECTs data from BigQuery and inserts ea...
Google Tag Manager sends data on Preview GTM Tool but it doesn't in production.
Hi community. Does anybody know why this is happening? My GTM works perfectly in the debug mode, the data is s...
Dataform different sources one target name
HelloMy team and I want to create a process where a target table gets data from several sources.All sources an...
Darshan Hiranandani :Error While Accessing or Creating GSheet Linked Tables -API Key Not Valid Issue
Hi everyone,I'm Darshan Hiranandani, I’ve been encountering an issue across multiple projects and tables since...
Replicating data from MySQL to BigQuery using Dataflow template
Hello BQ users! We recently published a step by step guide, which walks through how to set up data replication...
GA4>BQ streaming export, users_ table missing rows
Hi there,Until June 18 - streaming export creates events_, pseudo- and users_ tables as intended, no differenc...
Syntax error: Unexpected keyword WHERE at [5:1], Syntax error: Unexpected keyword WHERE at [4:1]
I enrolled for Google Data Analytics and started learning Google Query. In my queries, I keep having syntax er...
ReadFromBigQuery dinamically Apache Beam - Dataflow
I have a list of bigquery queries("SELECT JSON_CONTENT FROM project_id.ds.TB_1","SELECT TRANSACTION_ID FROMpro...
DCF using SQL (share & help needed)
Hi all,I'm not sure how many people will see this page but just wanted to share my SQL project related to disc...
How to Trigger a Retry in PubSub When Using Push Subscriptions
I have a google cloud function that is subscribed to a pubsub push-type subscription. Because of the setup, th...
Creating Composer 1 with Terraform fails
Hello. I'm getting this error when I'm trying to create a Composer 1 env with terraform.Error: Error waiting t...
Xxx,xxx finical reports
I'm confused on why I'm trying to do a deep comprehensive report and it's coming up as xxx and not giving me e...
Different values after dataform tables run with full refresh
I have encountered a strange issue with dataform, whereby a full refresh of the pipeline results in slightly d...
Getting roles and principals from bigquery table.
Hi,I'm trying to get all roles and principals in each one of my tables, like when in console access the link s...
Data reference from one sheet to another
In the attached sheet, I want to list info on the Pitches tab to the corresponding section on the Rolling Agen...
Policy Tags Not Appearing When Trying to Add To Column
Confirmed I have the Policy Tag Admin role but when I go to add a policy tag on a column when hitting "Edit Sc...
Looker dashboard for Firebase web app with BigQuery
Hello!I need to build a Looker dashboard for a script that was built with Firestore as part of a Firebase proj...
Billing bytes changes if insert into table
I have a select that, alone, is billing 1.61 GBHowever, if I insert the data into a table, it jumps to 22.65GB...
Looker Studio Report Not Updating with Changes in Connected Excel File
I have created a Looker Studio report that is connected to an Excel file as the data source. However, I'm enco...
DELETE/UPDATE/MERGE DMLs are currently not supported over tables that had UPSERT streams.
Hi , i am working on migrating data from rds to bq using datastream. and after the load has been completed i a...
PubSub to Dataproc Serverless
Is it possible to read events from GCP Pub/Sub (not Lite) using Spark (Structured Streaming) in Dataproc (Serv...
How to really stop a DAG from running on startup
Hello,We use Airflow on a daily basis but everything runs in a few hours during the morning. After everything ...
Kafka to BigQuery dataflow flex template doesn't migrate key
HiI'm trying to migrate Kafka JSON messages to BigQuery, including Kafka `key` value. I'm following docs here:...
Declare information_schema to multiple projects as a source in Dataform
Hi all,We are wanting to create a Dataform model that combines all of the BigQuery INFORMATION_SCHEMA.JOBS dat...
Articles from Product Experts and Googlers
Helping you learn Google Kubernetes Engine (GKE)
Learning complex technologies is hard. The sheer volume of information to absorb, along with the need to develop practical skills, can be overwhelming. Google Kubernetes Engine (GKE) is one of those complex technologies.
Simplify your compliance and security with Assured Workloads for Google Cloud NetApp Volumes!
We are thrilled to announce a significant enhancement to Google Cloud NetApp Volumes with the integration of Assured Workloads. This powerful combination empowers organizations to deploy NetApp Volumes in a rigorously secure and controlled environment, specifically designed to meet the stringent compliance demands of highly regulated sectors such as government, healthcare, and financial services.
LLMs vs. embeddings for Contextual Relevance Assessment
In many real-world applications, we encounter tasks that sit at the intersection of semantic understanding and contextual judgment. One such common scenario is determining if a set of keywords truly aligns with a brand, its products, and its messaging (like a tagline). This isn't just about whether the words are synonyms; it's about relevance in a specific context. Does "eco-friendly" align well with a fast-fashion brand's new line, even if the tagline mentions "sustainable materials"? Does "high-performance" fit a budget-friendly product?
