Influence Looker’s Roadmap and join the BI Customer Council (BICC)
Would you like to influence Google Cloud’s BI roadmap more? I’d like to invite you to join the Google Cloud BI...
Data Analytics
Want more from your data? Have questions about products like BigQuery, Dataflow, or Pub/Sub? You're in the right place. Join conversations around data warehouse modernization, streaming analytics, business intelligence, and more.
Focused on Looker? Engage with the Looker Community here.
Focused on Looker? Engage with the Looker Community here.
Forum Posts
Create Digital Clean Room listing with analysis rules via BigQuery Analytics Hub API
Hello,I've been recently playing with BigQuery Analytics Hub API version 1. I was able to programmatically cre...
Why Isn't Google Cloud's Data Analytics Platform More Accessible for Small Businesses?
As a small business owner, I'm finding it increasingly challenging to leverage advanced data analytics tools e...
Running into Syntax Error because my assigned project ID starts with True
My assigned by BQ project ID is true-episode-#. The exact error states "Syntax error: Unexpected keyword TRUE ...
message "Got an error reading communication packets" in Aurora MySQL error.log
Hi there, I'm building CDC flow with Datastream, from Aurora MySQL 3.05 to BigQuery.After starting Datastream,...
Automatic failure of a Dataform Action
Hello Community,I have the following situation: At some moment in time one Dataform Action fails. We have a co...
Dataplex dataScan Run Event
I am trying to configure a cloud function to begin upon completion of a Data Profile Scan. However, the only E...
Pub/Sub message stuck for specific ordering_key (user_id)
Hi, my workplace has been using pub/sub as messenger in our system.We use user_id as the ordering key, and thi...
Alternative for Tensorflow DataValidation
Hi Community, I'm using right now TensorFlow DataValidation to get some status of a tabular dataset that I hav...
Transfer BigQuery Table to Composer Bucket
Hi @ms4446 Here is my problem description:1) I am running an Airflow DAG and I am using the Cloud Composer. I ...
Error when trying to pin a dataset to the explorer
Just got started with bigquery and trying to pin a public dataset to the explorer so that I can start writing ...
Reg Expression for negative lookahead in Big Query
Hello, from a query like '--select * from vf-de-datahub.schema1.table1select *from vf-de-datahub.schema2.table...
How to export DV360 raw data to BigQuery
Hi, I'm currently working on some of the Google marketing sources data migration into BigQuery to analyze more...
Dataform CLI Compile Fails with ReferenceError.
Hi,I have a dataform project which compiles successfully in the gcp UI.However, when I try to run `dataform co...
Google Ads Data Transfer Service - Sporadic errors starting May 4th
Hi All. We've had mostly positive experiences with the new Google Ads Transfer service to pull in client data ...
Sensitive data protection Scan Configuration
Hi, I have created a scan configuration and it profiles the big query tables and updated the profile inspectio...
Job launched with flex template fails with "Failed to read the result file"
Hi, I'm just getting up and running with DataFlow and have been hitting some hiccups along the way. I have a c...
which column provides onDemand cost in Detailed data export?
I have the columns in detailed data export1. cost2. cost_at_list3. credits.amount4. effective_pricewhich provi...
BQ export from GA4 rollup appears to retain sessionIDs from the source properties
When pulling data from BigQuery for a linked GA4 rollup property, the sessionID appears to be retained from th...
Dynamically assign a "defaultDatabase" in the dataform.json file
Hello Community,I have the following situation in our project.We are using Dataform to transform some data tha...
Dataform Location Error
Hi all,I have the configuration below in my dataform.json file{ "defaultSchema": "datalake_analytics", "assert...
Having Issue with data
Hello,Im a beginner trying to do a project. I generated script from chat gpt for python where it will generate...
Data Fusion replication error
I updated my version of my data fusion instance and the process I had from replicating a sql server database t...
Start time workflow execution
Hi all, someone who has an explanation/solution for this? Dataform is running all my tables directly after eac...
No RSA performance data in Google Ads API though it should exist in Ad_Group_Ads table
Hi,I'm curious when reading that RSA asset report exists on performance (Ad_Group_Ad table),why is that missin...
Bigquery Query usage per user per day alert
Hello, i want to implement alerting for Bigquery quota query usage per day per user. As the quota is per user ...
Ways to share common code across different repositories in Dataform
How can I share common code, such as functions and variables, across different Dataform repositories? As my te...
Failure of creating private offer: The base StandardOffer has already expired for private offer
Hi guys!When I tried to create a GCP private offer, I got this error message.message":"com.google.apps.framewo...
Deploy dataform project from github to bigquery
HelloI would like to know if there is any way through CLI or API of dataform that allows me to take my existin...
Urgent: GCP and Google API Terms of Service Violation
Dear Community,We are reaching out for urgent assistance regarding a Terms of Service (ToS) violation issue en...
Dataproc high resource usage and its optimization and analysis
Hi,I'm using Dataproc on VMs. Currently we are running in production two clusters: master VM typeworker VM typ...
Articles from Product Experts and Googlers
BigQuery Data Preparation with AI Agents: Smarter, faster, and code-free
Ready to unlock the secrets hidden in your product data? This tutorial demonstrates how BigQuery Data Preparation can clean and transform your raw data into actionable business intelligence, using a realistic example from the Fashion and Beauty industry.
Launched: ABAP SDK v1.10 unleashing powerful AI/ML, eventing, and storage capabilities
Supercharge your SAP systems! ABAP SDK v1.10 unlocks BigQuery AI/ML, simplified event-driven integration, Cloud Storage content repositories & access to 290+ Google Cloud APIs. See what's new.
From idea to viral video: the GenAI workflow you need
What if you could create professional-quality videos with just a fraction of the effort? This blog introduces a radical new GenAI workflow on Vertex AI, using models like Gemini, Imagen3, MusicLM and Veo2 etc to make video creation accessible to everyone.
