Influence Looker’s Roadmap and join the BI Customer Council (BICC)
Would you like to influence Google Cloud’s BI roadmap more? I’d like to invite you to join the Google Cloud BI...
Data Analytics
Want more from your data? Have questions about products like BigQuery, Dataflow, or Pub/Sub? You're in the right place. Join conversations around data warehouse modernization, streaming analytics, business intelligence, and more.
Focused on Looker? Engage with the Looker Community here.
Focused on Looker? Engage with the Looker Community here.
Forum Posts
BigQuery infinite loop uploading 195x3 CSV file (3rd try)
Hi, learning BigQuery > I upload a CSV file with 195 rows of 3 short columns. Data looks like this:AFG Afghani...
GA4 Backfilling data
Hi,We have setup the GA4 properties and linked it to BigQuery after a couple of months. The data flows as expe...
Dataform roles to access BigQuery in another project
Hi there,Hope someone would be able to help with Dataform roles to access BigQuery in another project.I have G...
Bigquery transform service for Google merchant center data
Hello, I wanted to know if, Is there any way to filter out the categories when we load the data into BQ from t...
Workspace BigQuery Gmail logs: null values in mail_event_type from 2022-08-06 to 2023-03-15
Hello,I've noticed that Workspace Biquery Gmail logs didn't record any gmail.event_info.mail_event_type value ...
BigQuery Compressed/Physical Storage tier
Hello All,I am exploring BigQuery dataset new storage models for one of our client. One query hereWhen we conv...
Export to events tables stopped working
We have setup export of Google Analytics events to BigQuery via Firebase which has been working smoothly for 2...
Query data from google analytics data api without google library and without composer
Hello,I am coding an app in php and i want to query google analytics data api without the google library and w...
BigQuery JDBC connector for Tableau takes too long to create an extract
Hello,I'm trying to create an extract in Tableau using the BigQuery JDBC connector. I can successfully connect...
Pyspark job execution error in Dataproc- correlation column is not allowed in predicate
Data proc throwing errors while pyspark code which is developed in lower of pyspark of Data proc. How to handl...
Time out error
Hi,we are using this API to get the data from the query: google-api-services-bigquery-v2we have clients who ha...
Does Pubsub emulator supports streaming pull with Messagereciever
Does Pubsub emulator supports streaming pull with MessageReciever ?
getting issue with async await with node js client
Hi all,I am using "@google-cloud/bigquery": "^6.2.0", https://github.com/googleapis/nodejs-bigqueryI want to c...
Dataform. Model Documentation
Hi!Is there any way to extract the Dataform model documentation (i.e., table description, fields, etc), into a...
Error in Dataflow pipeline - reading json and writing to BQ
Hi everyone,I'm using a basic ETL pipeline to run in dataflow. Python script is in my default cloud shell VM f...
how to update the date in big query table has already records.
Hi All,I am using the node API client Library https://github.com/googleapis/nodejs-bigqueryhow to update the d...
Google Fit data upload to datasource faild.
Something wrong with Google Fit Rest API.API request：POST https://fitness.googleapis.com/fitness/v1/users/me/d...
Error while creating a BigLake table
I am trying to create a BigLake table and get the following error – You are missing permissions and may need t...
Is Offset Deterministic For BigQuery Unnesting Of Arrays?
I'm looking to create a set of BigQuery views that will unnest nested data so that we can import it into an un...
Trying to access Analytics project using http post with service account
We are able to access our Analytics data through postman (using Oauth 2.0). However, when using Postman we get...
Where in my BigQuery sql code do I fix the syntax error?
--I had no idea so many students are stuck in BigQuery, not a good sign for Google. I've wasted two days tryin...
missing intraday events
Hi,this is my intraday table events:- and this is my events table:- so in intraday missing data are from 6-12 ...
Issue with dataflow template "Text files on gcs to pubsub"
I got a error message with SDK version 2.48.0 while everything is normal in 2.47.0:Show More Error message fro...
BigQuery Argument to Sink Big Query Data Fusion Pipeline failed
GreetingsI received the following error while executing Data Pipeline in GCP Cloud Data Fusion. code 429 for i...
Trino on Dataproc
Hi everyone,im trying to enable Trino as optional component within dataproc like described at https://cloud.go...
Unable to create a DataSet in US Region
We are able to create a dataset in US region , from today onwards we are unable to create the dataset in US re...
Round function not producing expected output
Hi Team,We are using Round fucntion to round off RequestDuration column in our data pipeline.But round functio...
Simple queries on BQ fetching time is too long (~40s)
Hello,We simplified our production queries, so our queries are in the following format: "select {} from {} whe...
BigQuery - Running parameterized queries from DBeaver and Simba JDBC Driver (r 1.3.3)
Hi. I don't seem to be able to use parametrized BigQuery queries using DBeaver w. Simba JDBC driver.This googl...
Dataform - Cannot create workspace
Hello!I'm migrating my project from Dataform Legacy to GCP and found out that I cannot create a workspace. I g...
Articles from Product Experts and Googlers
Untangle the API maze with Apigee API Hub
Mirror mirror on the wall, What do I do with my API sprawl, Where can I see them all, How to make sure they listen to my call, And to ensure their compliance doesn’t fall. API Hub is the one to rule them all!
Next-Gen Data Pipelines: Airflow 3 Arrives on Google Cloud Composer
We are thrilled to announce that Google is the first hyperscaler to provide selected customers with access to Apache Airflow 3 on our fully managed Cloud Composer 3 service. Discover how powerful new features like DAG Versioning, a modern React-based UI, and scheduler-managed backfills can help you innovate faster and more reliably.
Configuring GKE rollout sequencing
You can manage the order of automatic cluster upgrades across Google Kubernetes Engine (GKE) clusters in multiple environments using rollout sequencing. For example, you can qualify a new version in pre-production clusters before upgrading production clusters.
