Influence Looker’s Roadmap and join the BI Customer Council (BICC)
Would you like to influence Google Cloud’s BI roadmap more? I’d like to invite you to join the Google Cloud BI...
Data Analytics
Want more from your data? Have questions about products like BigQuery, Dataflow, or Pub/Sub? You're in the right place. Join conversations around data warehouse modernization, streaming analytics, business intelligence, and more.
Focused on Looker? Engage with the Looker Community here.
Focused on Looker? Engage with the Looker Community here.
Forum Posts
Dataform external configuration
Hello everyone,My team is grappling with the challenge of scaling our Dataform code both robustly and as autom...
Total processed Billed Bytes at processing data at table object level in Bigquery
Hi,I see information schema JOBS view has "total_bytes_billed" at query/job level. May i possibly find the sam...
Query Google Trend using Big Query
I need help with google BigQuery. I am using big query to query data from Google Trends.I want to get data usi...
BQ I/O Connector - Storage Read API (Direct table access) - Performance degrade seen in Apache B2.50
Hello, We are seeing Dataflow pipelines taking 2x to 3x more time to run in Apache beam SDK ver 2.50 compared ...
biq.blue: Destroy Your Big Query Costs !
Hi!I've been working on Biq Blue a tool engineered to analyze your Google BigQuery tables, storage, and reques...
Date of Birth Compare Current date
Hi, im working on a bigquery to extract accurate total days, months and years from date of birth to current da...
Query google trend using google BigQuery
I need help with google BigQuery. Am using big query to query data from Google Trends. now I want to get data ...
Dataproc, Error when submit a file to dataproc serverless
Hi, when I try to submit a python file to batch I had the next error:The problem was on the path created for t...
Will Dataform support BQ ML as well?
My organization started utilizing BQ ML. While I assume it would be possible to run BQ ML commands with `type:...
what is the network traffic under name ssl for bigquery API
Hi, I am currently using bigquery API to extract data to my local server from the GCP BQ but my security team ...
Pub/sub subscription not sending out all messages at once
Hi all, I have a question re: pub/sub.My set up is as follows- I have a publisher creating about ~3000 message...
Datastream failed to find the publication
We're having a frustrating problem with Datastream. We set up a user in our Postgres (CloudSQL) db with all th...
Analysis Difference In blogger and Google Analytics
Hey , I have a issue with the analysis dashboard of the blogger and Google analytics. Blogger stats show me mo...
Datastream has error: the replication slot replication_slot status is 'lost' (wal_status)
Hello, I have created a stream to migrate data from Cloud SQL Postgresql to BigQuery, and it has been working ...
Oracle19c - Issue using db-link to GCP with Simba Driver
Dear All,In CASE 2, simba driver tries to find remote table in US location and not in UE location where it is....
DATAFLOW: The minimum amount of memory of a Dataflow worker instance is 1740 MB. The machine type se
Hello everyone!About this error,Workflow failed. Causes: The minimum amount of memory of a Dataflow worker ins...
Missing Events in Google Analytics triggers Towards Cloud Functions (1st Gen)
We have deployed this functionality in our firebase ecosystem. The events are marked for conversion & we see t...
Moving data from Big Query to GAM - Latency
Hi thereI'm looking at a publisher monetisation use case. I'm investigating ways of moving publisher audience ...
EXTERNAL_QUERY
As I followed all the steps you have said but I am still getting this error.i am using Public IP, i have given...
BigQuery - Simba JDBC Driver - DDL statements are not supported in a transaction
I was using Simba JDBC driver for BigQuery version 1.2 to drop a table in BQ if not exist and create it again....
DATAFLOW: Could not change log.info level
Hello again,I've been trying all day to custom the level of the logging Python library in my Beam data pipelin...
Alter column name of a GBQ table whose source is a google sheet
I have a GBQ table which is created from a google sheet. The names of the columns have been updated in the goo...
SparkContext: Error initializing SparkContext.
Hi Guys !! I am using Dataproc serverless for executing the Pyspark script that I took from official documenta...
I would like to know about the ID contained in user_pseudo_id.
From reading the documentation, I recognize that user_pseudo_id is to get the temporary ID of the user.I am ge...
Is there a unique ID that can be obtained in GA4 that can be used to identify an individual?
We are checking to prove that individuals cannot be identified by the unique ID that can be obtained from GA4....
Looker Studio take too much time to load charts
I have a problem with looker studio as demonstrated in the video. The dashboard takes too long to load, in thi...
Datafusion Mongodb record duplicate record problem
Hello, I'm trying to read data from MongoDB and send it to a BigQuery sink.I'm having issues reading the data ...
Dataprep: Duplicate rows based on key with multiple values in columns how to clean
Hi there,I have a DS with duplicates for my key value. These are users that have signed up with different name...
Is there Dataform API that can extract lineage on workflows?
Hello, Is there any Python APIs or some kind of metadata extractions we could have from Dataform? My team is l...
Datastream not pulling change data from RDS Postgresql
I followed the on screen instruction to connect datastream from AWS RDS Postgresql to Bigquery. Enabled logica...
Articles from Product Experts and Googlers
Helping you learn Google Kubernetes Engine (GKE)
Learning complex technologies is hard. The sheer volume of information to absorb, along with the need to develop practical skills, can be overwhelming. Google Kubernetes Engine (GKE) is one of those complex technologies.
Simplify your compliance and security with Assured Workloads for Google Cloud NetApp Volumes!
We are thrilled to announce a significant enhancement to Google Cloud NetApp Volumes with the integration of Assured Workloads. This powerful combination empowers organizations to deploy NetApp Volumes in a rigorously secure and controlled environment, specifically designed to meet the stringent compliance demands of highly regulated sectors such as government, healthcare, and financial services.
LLMs vs. embeddings for Contextual Relevance Assessment
In many real-world applications, we encounter tasks that sit at the intersection of semantic understanding and contextual judgment. One such common scenario is determining if a set of keywords truly aligns with a brand, its products, and its messaging (like a tagline). This isn't just about whether the words are synonyms; it's about relevance in a specific context. Does "eco-friendly" align well with a fast-fashion brand's new line, even if the tagline mentions "sustainable materials"? Does "high-performance" fit a budget-friendly product?
