Data at Google Cloud Next '24!
Answer this question in the comments to earn a special badge: In your journey, what's one overlooked data skil...
Forum Posts
Influence Looker’s Roadmap and join the BI Customer Council (BICC)
Would you like to influence Google Cloud’s BI roadmap more? I’d like to invite you to join the Google Cloud BI...
GA4 backfill - data transfer service
Hello,Like many GA4-BigQuery users I've misunderstood the GA4 data "backfilling" capabilities. This is partial...
JsonStreamWriter and ExecutorProvider
I couldn't find good explanation how JsonStreamWriter is using the provided ExecutionService.In Java.What is t...
Not able to run Dataflow
Hi!Recently I have been trying to create a dataflow for a batch job copying data from MongoDB into BigQuery. I...
How to know if BQ query was run from console
I have log sink where i'm routing jobservice.jobcompleted to Pub/Sub. Idea of this is to check that all the jo...
Transform RawData Bq table to Json Bq table
Hi everyone,I'm facing a major issue this week and need a solution as quickly as possible. I have a table with...
Recomendation: JSON vs repeated key-value records for unstructured data
I'm in the process of designing a data warehouse for BI purposes, where I want to ingest events from different...
Looker Studio Schedule Delivery has Error
I am setting up schedule delivery of my Looker studio report but the email I get shows an Error.Data Set Confi...
Snowflake to BigQuery migration
Could anyone please help me understand the following:I need to migrate data from Snowflake to BigQuery using t...
Writing streaming data to BigQuery via I/O connector using a Dataflow job
I am using the `STORAGE_WRITE_API` method using BQ I/O connector to write data to BQ from a DataFlow job. I am...
Hidden Gems of BigQuery News — Materialized views changes (April 2024)
There are a lot of cool new things happening in BigQuery in April. That makes it easier to miss smaller, but n...
Natural language support in BigQuery
I want to create an application to obtain data in BigQuery from a user message. I saw that Gemini in BigQuery ...
Using BigQueryTemplate for streaming ongoing inserts
From a java application (spring) i need to stream (insert) ongoing data (1TB per day).Can i use for this BigQu...
Error connecting big query from Zeppelin
The query runs normally for the public dataset, but returns an error for the private dataset. When using priva...
Column Lineage in Google Dataplex
Hello, I know that we can visualize Table lineage in Dataplex. Is it possible to visualize Column Lineage for ...
Session Id with multiple session number for the same user
Hello Everyone, I'm currently working on GA4 data stored in our BQ. While digging into it, I found that for a ...
Data at Google Cloud Next '24!
Answer this question in the comments to earn a special badge: In your journey, what's one overlooked data skil...
Load 130.000 csv files to BigQuery. Limitation loading jobs
Hello, I have 130.000 csv files in GCS. I am uploading them via bigquery.Client() . But the problem is that ap...
How to track app download by using utm tags link?
Hi there, Hope you will be able to help me. How to i track app download by using UTM tag link with Android pla...
Mismatch data between google ads UI Report and Data pulled from Data Transfer
I'm currently using data transfer to upload data into BigQuery from a google ads account. I've noticed that th...
Error when trying to pin a dataset to the explorer
Just got started with bigquery and trying to pin a public dataset to the explorer so that I can start writing ...
Importing Google Sheets into a BigQuery Table
Hi I am importing a table into a BigQuery Dataset from a Google Sheet, using the URL from Google Drive. Is the...
SQL Spark connection in juptyerlab
Hi,I have a Dataproc cluster and using the web interface (Jupyterlab) inside the cluster, I am trying to read ...
Create Python Notebook button is unavailable in BigQuery
Hi there!I want to create a Python notebook on a BigQuery console but the button is unavailable. It also shows...
Dataplex Capabilities
Just kicking the tires here on Dataplex to see if it is the right fit. We are interested in its governance cap...
POST API data to Big Query
I am trying to figure out what is the easiest way to connect our CRM's REST API. The CRM we use in Inline Data...
Historical Google Ads account data via GBQ Data Transfer.
Hi! I am trying to retrieve historical data on cost and clicks for a Google Ads account via Data Transfer in G...
Concurrent UPDATES or INSERTS to a BQ table
Hello Community,I am building a validation process for checking whether a .csv file was successfully ingested ...
BigQuery returning `There is no data to display.`
I've setup a Datastream CDC into BigQuery stream. The stream started without issues and is currently showing t...
Seeking Guidance: Error Connecting to AWS S3 via BigQuery External Connections
I am currently working on a project that involves leveraging the BigQuery - External Connections feature to ac...
Pushing CDC data from pubsub to BQ
Hi All,I would like to understand what are the ways by which I can handle the CDC data present in pubsub & pus...