Influence Looker’s Roadmap and join the BI Customer Council (BICC)
Would you like to influence Google Cloud’s BI roadmap more? I’d like to invite you to join the Google Cloud BI...
Data Analytics
Want more from your data? Have questions about products like BigQuery, Dataflow, or Pub/Sub? You're in the right place. Join conversations around data warehouse modernization, streaming analytics, business intelligence, and more.
Focused on Looker? Engage with the Looker Community here.
Focused on Looker? Engage with the Looker Community here.
Forum Posts
Dataplex is recreating the Default bigquery table
I have deleted the default bigquery table that is created with the dataplex zone from the entities tab. But da...
Is there a way to get a report of Landing Pages in Google Ads via BigQuery Data Transfer Service
0I am currently in the process of creating an overview of ad spent per landing page/destination url. We are us...
Who Trigger the Job in BigQuery Question
Is there a way we can tell who/which human ID submitted a BigQuery job if it runs using a SA?
BigQuery Cross-Regional Replication
Hello,I am trying to move a dataset from EU to me-central1, I created the replica and tried promoting the seco...
How to resolve QuickBooks Error ps033 - payroll error
I'm experiencing QuickBooks Error PS033 when trying to update my payroll. It says my company file is damaged. ...
run a dataform pipeline using a dataform_v1beta tag
I'm trying to run a dataform pipeline using a specific tag using the client's libraries, but I can't find a co...
Hive Partition Load - Unable to set a field mode to REQUIRED during load from GCS
I am attempting to load externally partitioned data into a BigQuery table using Python. The BQ table in questi...
How to create a filter that is based on another dimension with different timeframe for each row
Hi all!I have a list of stores and each started supplying a different date. I need to calculated what was thei...
Reg Exp for selecting particular strings from a query
Hello, I would like to know which reg expr can extract relevant schema and table from the following query: Que...
The backlog increases at certain times, even though the subscription speed remains steady.
Even when the subscription rate matches the publishing rate, the backlog count continues to increase during ce...
Clarification on Dataform Repository Size Limitations and Actions vs. SQL Workflow Nodes
Hello Dataform Community,I'm currently working with Dataform and trying to better understand some of the speci...
Dataform cannot find upstream view if using workspaceName
When Schema Suffix is set to `${workspaceName}`, I start getting errors like the following:```Not found: Datas...
How Do I Fix "QuickBooks the File You Specified Cannot Be Opened" Error?
I'm trying to open my QuickBooks company file, but I keep getting an error message that says, "The file you sp...
Dataform: Loading data from local CSV file
I want to be able to load data from a local csv file to a Bigquery table (i.e similar to the dbt command) and ...
How to provide permission to BigQuery datasets
Hi. I have several datasets in my project. Please tell me how to provide access to the project, but not to all...
BigQuery export using FOR SYSTEM_TIME AS OF
Is there a way to export a BigQuery table with respect to a past time using time travel. Snapshot and clone al...
DATAFORM- CSV GCS using Dataform to Bigquery
I am trying to bring data from a .csv file from Google Cloud Storage to Bigquery using Dataform, however the j...
Logging service client returns a lot less log entries than what I got from log explorer
In Log Explorer, run the following query for the last 30 days got 51 entries.resource.type="cloud_dataproc_clu...
Datastream Issues
We are encountering a problem with the synchronization of data from MySQL to BigQuery through Datastream. An e...
Issue with BigQuery Data Streaming using google-cloud-bigquerystorage 2.24.2
I am experiencing an issue with my BigQuery data streaming application, which uses the following dependency: c...
Creating a remote function from Dataform
Hello Community,We need in our project, from a Dataform Workflow to trigger a Cloud Run Workflow via an end po...
Insufficient Permissions Error When Fetching Data from Google Analytics to Custom Dashboard
Hello everyone,I'm encountering an issue with fetching data from Google Analytics to a custom-built dashboard ...
Events from Firebase Analytics not showing up in Big Query after a specific date
Hello Everyone,I have linked Firebase with Big Query, and I was consistently receiving the 'app open' event fr...
BQ Admin but cannot access INFORMATION_SCHEMA.TABLES
I have the IAM role of Bigquery Admin, yet when I try execute an INFORMATION_SCHEMA.TABLES query I get the err...
Issue with BigQuery Data Streaming using google-cloud-bigquerystorage 2.24.2
I am experiencing an issue with my BigQuery data streaming application, which uses the following dependency: c...
Dataflow template - Streaming - Mongo DB CDC to Bigquery
I am using the Dataflow Mongo cdc to Bigquery template to create a pipeline that listens to Mongo DB change st...
BigQuery check if two strings are different by exactly 1 character
I have a long (18 million) list of short (sub ten character) strings. I need to compare them all to each other...
Googl Cloud Statistic
Hi,I would like to know number of select queries for all tables or views from the particular project, which wa...
Using DMS instead of pub/sub for transaction data
I need some help with a GCP based architecture that I am trying to design.Here is the scenario: Some point-of-...
context timeouts during composer upgrades and python package additions
Show More We are experiencing issues with cloud composer upgrades and the addition of pypy packages to the sys...
Articles from Product Experts and Googlers
BigQuery Data Preparation with AI Agents: Smarter, faster, and code-free
Ready to unlock the secrets hidden in your product data? This tutorial demonstrates how BigQuery Data Preparation can clean and transform your raw data into actionable business intelligence, using a realistic example from the Fashion and Beauty industry.
Launched: ABAP SDK v1.10 unleashing powerful AI/ML, eventing, and storage capabilities
Supercharge your SAP systems! ABAP SDK v1.10 unlocks BigQuery AI/ML, simplified event-driven integration, Cloud Storage content repositories & access to 290+ Google Cloud APIs. See what's new.
From idea to viral video: the GenAI workflow you need
What if you could create professional-quality videos with just a fraction of the effort? This blog introduces a radical new GenAI workflow on Vertex AI, using models like Gemini, Imagen3, MusicLM and Veo2 etc to make video creation accessible to everyone.
