Influence Looker’s Roadmap and join the BI Customer Council (BICC)
Would you like to influence Google Cloud’s BI roadmap more? I’d like to invite you to join the Google Cloud BI...
Data Analytics
Want more from your data? Have questions about products like BigQuery, Dataflow, or Pub/Sub? You're in the right place. Join conversations around data warehouse modernization, streaming analytics, business intelligence, and more.
Focused on Looker? Engage with the Looker Community here.
Focused on Looker? Engage with the Looker Community here.
Forum Posts
Timezone in BigQuery
I've encountered an issue where some of my datetime fields are stored in the UTC+2 timezone, while others are ...
Data Profiling using DataPlex
Is there a way that I can add custom statistics to my Data profile scan according to my own needs? Or is there...
4XX errors while loading Google scripts through server-side tagging
So I set up server-side tagging with App Engine (Google Cloud Platform).I came across this article "Load Googl...
Storage Write API ValueError generator already executing
I'm writing to a Bigquery table as shown here. try: insert_rows_write_api(dataset_id, HISTORY_WRITE_API_TABLE_...
Capturing and extracting code from BigQuery Lineage using Lineage REST API
I'm successfully automatically capturing lineage from BigQuery and I'm able to see the SQL code in the lineage...
blob_list not listing current directory.
Hi,I have a scenario, tried multiple options but it is not working.Suppose I have a directory/files,Source:gs:...
Querying INFORMATION_SCHEMA.TABLE_STORAGE in BigQuery gives an access denied error
I'm trying to query the TABLE_STORAGE view in my BigQuery project to get storage information about my tables. ...
Querying Iceberg Table and its history
I have few tables setup according to this guide: https://cloud.google.com/bigquery/docs/iceberg-tables and thi...
PySpark stored procedure in BigQuery throws a syntax error
Hi,I'm trying to create a stored procedure using inline PySpark code like this: https://cloud.google.com/bigqu...
I want to know that Youtube Content Owner id
I'm trying to use BigQuery Transfer to pull in data for YouTube content owners.The following error occurred to...
Scenario to test Onfailure() method of ApiFutures callback.
Hi Team,We are new to Gcp bigquery and started implementing storage API stream writer to ingest data to BQ in ...
import Google play data to BigQuery
Hello,I have managed to import Google play data using Data transfer service to Bigquery.i noticed that from Go...
Looker Refresh Rate
I have a integration between BQ and Looker. I can see in BQ table that the data it new but only reflects on Lo...
BigQuery's Storage Write API _default stream unavailability after table re-creation
Hi, everyone.I've come across an "interesting" behavior with the Storage Write API in the Java library. I'm cu...
Spark Streaming with PubSub Lite
I want to create a Spark Streaming application in DataProc that has a subscription to PubSub Lite or PubSub (I...
vpc sc effect on looker studio blends
We are using bigquery as our data warehouse.Our data analysts are using looker studio as their data analytics ...
SQL to Big Query Data Fusion Pipeline failed
Im trying to build google data fusion pipeline to load data from MS SQL server to Big Query. The source (MS Sq...
Defining Lakes in DataPlex
Hi,I want to define "Lakes" in Dataplex but I am unsure as to what level these should be set at. The documenta...
Dataflow enable_google_cloud_profiler dataflow_service_options not working
Hi,We are trying to enabled the Google Cloud Profiler for Dataflow using dataflow_service_options -> enable_go...
Facing the error which connecting cloudSQL MSSQL server using JDBC in dataproc
when i am running the same pyspark job to read the cloud sql data using jdbc in pycharm on local machine where...
Cloud SQL MSSQL not connecting from dataproc & dataproc serverless using jDBC
The cloud sql MSSQL which i created , i am able to connect it from sql server management studio on my laptop (...
Need a way to stop sending duplicate records into GCP Big Query with Stream Storage API
Hi Team,we want to insert the data into GCP bigquery with Storage API, we are able to achieve to insert data t...
BigQuery table to csv and email
Hi,I have done some transformations in Dataform and have BQ tables consisting of the transformed data. I have ...
Bigquery Concurrency
Hello,We are running a multi threaded python application which makes the Bigquery connection to read some data...
Hidden gems of BigQuery — P7 — Safety first
New post in Hidden gems of BigQuery series: https://medium.com/google-cloud/hidden-gems-of-bigquery-p7-safety-...
Dataproc serverless accepts only Spark 3
Hello Hi realy would like to test a series of spark 2.4 jobs on dataproc serverless but there is only spak 3.x...
Firebase export intraday events does not migrate to main events table
Hello, As far as I know, the intraday table is a temporary table which eventually merges into the main events_...
Preview Issue - TikTok , GA4 and Facebook CAPI using sGTM for our client
We are using Kubernetes and GCP for our client to setup the sGTM tagging. We are facing an console error issue...
No email notifications end out for failed Transfer job
Hi,I am using Data Transfer and Scheduled Query a long time. I have now a new GCP project. After setting up a ...
BigQuery - incrementable tables
I am currently running a pipeline through Airflow every 12 hours. Each time the pipeline is run, the BigQuery ...
Articles from Product Experts and Googlers
BigQuery Data Preparation with AI Agents: Smarter, faster, and code-free
Ready to unlock the secrets hidden in your product data? This tutorial demonstrates how BigQuery Data Preparation can clean and transform your raw data into actionable business intelligence, using a realistic example from the Fashion and Beauty industry.
Launched: ABAP SDK v1.10 unleashing powerful AI/ML, eventing, and storage capabilities
Supercharge your SAP systems! ABAP SDK v1.10 unlocks BigQuery AI/ML, simplified event-driven integration, Cloud Storage content repositories & access to 290+ Google Cloud APIs. See what's new.
From idea to viral video: the GenAI workflow you need
What if you could create professional-quality videos with just a fraction of the effort? This blog introduces a radical new GenAI workflow on Vertex AI, using models like Gemini, Imagen3, MusicLM and Veo2 etc to make video creation accessible to everyone.
