Influence Looker’s Roadmap and join the BI Customer Council (BICC)
Would you like to influence Google Cloud’s BI roadmap more? I’d like to invite you to join the Google Cloud BI...
Data Analytics
Want more from your data? Have questions about products like BigQuery, Dataflow, or Pub/Sub? You're in the right place. Join conversations around data warehouse modernization, streaming analytics, business intelligence, and more.
Focused on Looker? Engage with the Looker Community here.
Focused on Looker? Engage with the Looker Community here.
Forum Posts
Migration from Excel to Google Cloud
Hi! We plan to move from Excel to the Google ecosystem, but to simplify the transfer of tables to Google as mu...
Datastream concurrency issue
I'm currently using Google Cloud Datastream to replicate data from MySQL to BigQuery.My Flow is : Mysql---->Da...
Create an incremental table that depends on it self
I have 2 tablesraw_logs_tablecondensed_log_tableI want to insert new records into condensed_log_table but to c...
Vertex AI - running pyspark in jupyter notebook
Hi,I am currently converting some Alteryx workflows into pyspark and wanted to test the codes for debugging an...
Working with multiple repositories in GCP Dataform
Hello there,We originally had one Dataform repository but due to the large number of Dataform actions and comp...
BigQuery & GA4 - session source / medium
Hi, I am working on a dashboard that is based on BigQuerythere are several conversions I am sending to BigQuer...
Pubsub Schema creation from .avsc file
Can we maintain schema registry for Pubsub in GCS ? If possible please share example or documentation link for...
BigQuery/GA4, all events since this morning have the same bundle sequence id
Hello. We're trying to track down what seems like a bug with GA4/BigQuery. In our intraday tables for today, n...
Real time streaming of analytics table in BQ to Pub/Sub
Hi, Am currently working on a POC. We are leveraging Google analytics for our website and capturing the traffi...
Darshan Hiranandani : How to Transfer Data from BigQuery Table to Cloud Storage
Hi everyone,I am Darshan Hiranandani, looking to transfer data from a BigQuery table to Cloud Storage and woul...
Creating a Log Sink to Route Cloud SchedulerJob Logs to BigQuery
Hello,I am working on setting up a log sink using Terraform to route logs from cloud scheduler jobs to a BQ ta...
TimeOutException when publish message protobuf
Configuration: projectA, topicA, subscriptionAAt server application. when publish message received TimeOutExce...
Use Dataplex to scan BigQuery asset in different org
Can Dataplex read/scan assets in a different GCP Org? Specifically BQ datasets in Org B if I've configured my ...
datastream handle schema change
I have datastream set up to stream cloudsql postgres tables to BigQuery. It seems like DataStream can't handle...
Access Denied: BigQuery: Missing required OAuth scope. Need BigQuery or Cloud Platform writ
Access Denied: BigQuery BigQuery: Missing required OAuth scope. Need BigQuery or Cloud Platform write scope.I ...
[Dataform] How to create an incremental table with a list of columns pulled from INFORMATION_SCHEMA?
Use case:We have a table `aggdata.locations` that is frequently being updated with new columns.We want to be a...
Get Google Business Notifications from push Pub/Sub
Hello I'm trying to be notified when a new review is added on my Google Business Profile.According to the doc...
"<table_name> did not meet condition IF_MATCH" error on random table executions.
I frequently get BigQuery log entries for these types of errors during Dataform executions. Even though this e...
Incremental models using self have the same bytes billed
Hi there,We are on on-demand billing (billed per bytes processed).We are finding that when we run the recommen...
Getting location info updates from google business using pub/sub
I've setup the Pub/Sub in order to receive update from Google My Business.So far, I've experienced decent resp...
Webhook for Google Reviews
Hello, I'm currently working on setting up a webhook or some form of notification within my Google Business Ac...
Data Transfer from BigQuery into Analytics Funnel
Hi Community!I have a question regarding the connection between BigQuery and an analytics funnel.Currently, we...
How to export data from a BigQuery table to Cloud Storage?
When attempting to export data from a BigQuery table to Cloud Storage, you encountered an issue. The error mes...
File transfer from AWS S3 to GCS
Hi @ms4446 I am doing a file transfer from AWS S3 to GCS for which I have a DAG running through CloudComposer....
Big Query slow frame rate issue
Anyone else facing the issue of slow frame rate of big query ?? Yes, the frame rate of big query is too slow a...
Dataform - bitbucket link fails after removing the connection with the repo
Hi everyone.I'm having issues with Dataform and the link with Bitbucket via SSH. I linked a bitbucket repo to ...
BigQuery Data Transfer Service for Google Ads - Trouble Finding Specific Conversion Data
Hi,We've had Google Ads transfers setup with our big query cluster for awhile now. Set it up via https://cloud...
Is Dataform HIPAA compliant?
Hi, I wanted to use Dataform to run BigQuery SQL queries. But I didn't find Dataform in the list of HIPAA-comp...
Import Data to BigQuery
Hi, Is it possible to download event data from Firebase and dump it back to BigQuery in the same format as it ...
How to categorise an excel sheet of customer reviews?
Hi - new to google cloud!I was wondering if theres a way to categorise customer reviews in an excel sheet to c...
Articles from Product Experts and Googlers
BigQuery Data Preparation with AI Agents: Smarter, faster, and code-free
Ready to unlock the secrets hidden in your product data? This tutorial demonstrates how BigQuery Data Preparation can clean and transform your raw data into actionable business intelligence, using a realistic example from the Fashion and Beauty industry.
Launched: ABAP SDK v1.10 unleashing powerful AI/ML, eventing, and storage capabilities
Supercharge your SAP systems! ABAP SDK v1.10 unlocks BigQuery AI/ML, simplified event-driven integration, Cloud Storage content repositories & access to 290+ Google Cloud APIs. See what's new.
From idea to viral video: the GenAI workflow you need
What if you could create professional-quality videos with just a fraction of the effort? This blog introduces a radical new GenAI workflow on Vertex AI, using models like Gemini, Imagen3, MusicLM and Veo2 etc to make video creation accessible to everyone.
