Influence Looker’s Roadmap and join the BI Customer Council (BICC)
Would you like to influence Google Cloud’s BI roadmap more? I’d like to invite you to join the Google Cloud BI...
Data Analytics
Want more from your data? Have questions about products like BigQuery, Dataflow, or Pub/Sub? You're in the right place. Join conversations around data warehouse modernization, streaming analytics, business intelligence, and more.
Focused on Looker? Engage with the Looker Community here.
Focused on Looker? Engage with the Looker Community here.
Forum Posts
Datastream analysis bigquery
Hello, good morning, I was searching for some information about Datastream and BigQuery and did not find anyth...
Policy tags in Bigquery
There is case where we mask data in one column in a table and we don't mask the same column in other table.so ...
Query BQ External Table from Compute Engine
Hi Team,While access from VM using individual ID/User define service account ,we are able to access the data f...
removing columns from data stream to bigquery datafow job
Hi ,I have a dataflow streaming job running with a datastream to big query template , now my source data base ...
GCPPub
Our application is using GCP PubSub.We have setup the consumer asspring.cloud.gcp.pubsub.function.definition= ...
Datastream to bigquery data flow template problem
I have a streaming job in datastream which streams the data from mysql to cloud storage in avro format and I h...
Bigquery data movement from stg table to main table
Hi,we are streaming data to stg table and has duplicate events. Now Using some technique data has to move to m...
Facing Latency issue in GCP
Hi,I'm encountering a latency problem with GCP. Could you kindly offer a solution, please?
localhost refused to connect - pandas GBQ
While running python script using "pandas GBQ" that reads and write on Big Query, I am getting a URL to authen...
Track BigQuery Editions costs by reservation
Hi,We're using BigQuery Editions and have a few reservations set up. They each have a limit they can autoscale...
Insert/Update to GCP Bigquery using Spring boot
Hi @, I need to insert/update data received from another saas based application to GCP bigquery, could you sug...
DataFlow job converted into pipeline scheduled not running
Dear All,I'm quite new to DataFlow, I've build a job to read data from SQL Server and write into BigQuery. Whe...
using free looker for a test project
Hi,I would like to use looker studio to develop a dashboard for demonstration. I don't have a budget for it ye...
Issue create view when the source table and column have the same name
Hey,I have an Issue when trying to create view when the source table and column have the same name.The view is...
Issue on Automating Snowpipe for Google Cloud Storage
When my trying to create pipe via below command ,I am getting error Command: CREATE OR REPLACE PIPE GCS_SNOWPI...
The difference between release and workflow configurations doesn't click for me.
I'm currently working in an environment where pretty much everything is done with scheduled queries. There is ...
ERROR : INVALID_ARGUMENT jobInternalError on Kafka BigQuerySinkConnector
HiWe use Kafka BigQuerySinkConnector to update partitioned tables in a dataset, From time to time, we have an ...
GA4 events table is missing
Hi All,I have 1.5 months of events data got missing and it has been few months for that. I checked the logs fo...
Should Dataform be the default for scheduled queries and transformations?
We have recently delved into the world of data form and its benefits are obvious, from collaboration, versioni...
Grouping columns descriptions in Dataform
Hi there, I have the code below in a docs.js file in Dataform includes folder. However, it seems not working a...
Data fusion replication job sql connection issue
Hi Im trying to build data fusion replication job from ms sql server (cloud sql) to big query. Both data fusio...
Clear Looker Cache
Hi All,I've Looker dashboard which connects to BigQuery table. I've the data cache settings to persist for 6 h...
Does Google Config Connector Support PubsubSchema Evolution ?
Does Google Config Connector Support PubsubSchema Evolution ?If yes then can you update the ConfigConnector do...
Datastream - Unknown error when creating stream between self-managed PostgreSQL and BigQuery
Hello,I am unable to create a stream between a self-managed PostgreSQL instance and BigQuery.All connectivity ...
BQ not showing correct data from GSC connection
I've got 2 issues right now that I'm hoping I can get some support for, both relating to Big Query integration...
Workflows run Dataform repo that connected to Github
Hi all,I wonder if any can help?I've connected Dataform repo to Github repo and I've also triggered via Workfl...
Materialized View Odd Behavior
I have a source table that's pretty large. It's partitioned by day but has no cluster on it for now.I have a b...
Required Metric/Quota names to set up Alerts for BigQuery API Limits
Hi Team,We want to set up the Limit exceeded Alerts for below BigQuery API Limits.1. Maximum number of API req...
BigQuery Storage Write API and multiple tables
Hi everybody,I am implementing a service in GO that will stream incoming logs (from other services) into BigQu...
Multiple Database Tables from Oracle in DataFusion
I want to load multiple tables from an Oracle db using DataFusion, I am using "Multiple Database Tables".If I ...
Articles from Product Experts and Googlers
BigQuery Data Preparation with AI Agents: Smarter, faster, and code-free
Ready to unlock the secrets hidden in your product data? This tutorial demonstrates how BigQuery Data Preparation can clean and transform your raw data into actionable business intelligence, using a realistic example from the Fashion and Beauty industry.
Launched: ABAP SDK v1.10 unleashing powerful AI/ML, eventing, and storage capabilities
Supercharge your SAP systems! ABAP SDK v1.10 unlocks BigQuery AI/ML, simplified event-driven integration, Cloud Storage content repositories & access to 290+ Google Cloud APIs. See what's new.
From idea to viral video: the GenAI workflow you need
What if you could create professional-quality videos with just a fraction of the effort? This blog introduces a radical new GenAI workflow on Vertex AI, using models like Gemini, Imagen3, MusicLM and Veo2 etc to make video creation accessible to everyone.
