Influence Looker’s Roadmap and join the BI Customer Council (BICC)
Would you like to influence Google Cloud’s BI roadmap more? I’d like to invite you to join the Google Cloud BI...
Data Analytics
Want more from your data? Have questions about products like BigQuery, Dataflow, or Pub/Sub? You're in the right place. Join conversations around data warehouse modernization, streaming analytics, business intelligence, and more.
Focused on Looker? Engage with the Looker Community here.
Focused on Looker? Engage with the Looker Community here.
Forum Posts
Data Loss Prevention
Hey I am using GCP DLP, when I run the discovery scans on the tables they missed out on few columns which does...
Credit Group - How to access
Hi, I was added to a group to access the google cloud skill boost credits owned by a person. I received mail r...
Credits for lab
Hi, I am currently learning Google cloud data analytics. To complete the module 1, I need to complete the lab ...
Converting GA4 events in BigQuery into structured Tables
Is there a way to convert(extract) the events_ into tables by using Dataflow Jobs or any other methods in GCP ...
Cloud Composer Dag Storage
Hey all,I currently have a working Cloud Composer (Airflow) environment with 50 or so Dags. Generally, my code...
Blocking mobile app events via Google Tag Manager
Hi there, Hope someone will be able to help me.What i'm trying to do is to block certain events to be sent to ...
Migration from Excel to Google Cloud
Hi! We plan to move from Excel to the Google ecosystem, but to simplify the transfer of tables to Google as mu...
Datastream concurrency issue
I'm currently using Google Cloud Datastream to replicate data from MySQL to BigQuery.My Flow is : Mysql---->Da...
Create an incremental table that depends on it self
I have 2 tablesraw_logs_tablecondensed_log_tableI want to insert new records into condensed_log_table but to c...
Vertex AI - running pyspark in jupyter notebook
Hi,I am currently converting some Alteryx workflows into pyspark and wanted to test the codes for debugging an...
Working with multiple repositories in GCP Dataform
Hello there,We originally had one Dataform repository but due to the large number of Dataform actions and comp...
Pubsub Schema creation from .avsc file
Can we maintain schema registry for Pubsub in GCS ? If possible please share example or documentation link for...
BigQuery/GA4, all events since this morning have the same bundle sequence id
Hello. We're trying to track down what seems like a bug with GA4/BigQuery. In our intraday tables for today, n...
Real time streaming of analytics table in BQ to Pub/Sub
Hi, Am currently working on a POC. We are leveraging Google analytics for our website and capturing the traffi...
Darshan Hiranandani : How to Transfer Data from BigQuery Table to Cloud Storage
Hi everyone,I am Darshan Hiranandani, looking to transfer data from a BigQuery table to Cloud Storage and woul...
Creating a Log Sink to Route Cloud SchedulerJob Logs to BigQuery
Hello,I am working on setting up a log sink using Terraform to route logs from cloud scheduler jobs to a BQ ta...
TimeOutException when publish message protobuf
Configuration: projectA, topicA, subscriptionAAt server application. when publish message received TimeOutExce...
Use Dataplex to scan BigQuery asset in different org
Can Dataplex read/scan assets in a different GCP Org? Specifically BQ datasets in Org B if I've configured my ...
datastream handle schema change
I have datastream set up to stream cloudsql postgres tables to BigQuery. It seems like DataStream can't handle...
Access Denied: BigQuery: Missing required OAuth scope. Need BigQuery or Cloud Platform writ
Access Denied: BigQuery BigQuery: Missing required OAuth scope. Need BigQuery or Cloud Platform write scope.I ...
[Dataform] How to create an incremental table with a list of columns pulled from INFORMATION_SCHEMA?
Use case:We have a table `aggdata.locations` that is frequently being updated with new columns.We want to be a...
Get Google Business Notifications from push Pub/Sub
Hello I'm trying to be notified when a new review is added on my Google Business Profile.According to the doc...
"<table_name> did not meet condition IF_MATCH" error on random table executions.
I frequently get BigQuery log entries for these types of errors during Dataform executions. Even though this e...
Incremental models using self have the same bytes billed
Hi there,We are on on-demand billing (billed per bytes processed).We are finding that when we run the recommen...
Getting location info updates from google business using pub/sub
I've setup the Pub/Sub in order to receive update from Google My Business.So far, I've experienced decent resp...
Webhook for Google Reviews
Hello, I'm currently working on setting up a webhook or some form of notification within my Google Business Ac...
Data Transfer from BigQuery into Analytics Funnel
Hi Community!I have a question regarding the connection between BigQuery and an analytics funnel.Currently, we...
How to export data from a BigQuery table to Cloud Storage?
When attempting to export data from a BigQuery table to Cloud Storage, you encountered an issue. The error mes...
File transfer from AWS S3 to GCS
Hi @ms4446 I am doing a file transfer from AWS S3 to GCS for which I have a DAG running through CloudComposer....
Big Query slow frame rate issue
Anyone else facing the issue of slow frame rate of big query ?? Yes, the frame rate of big query is too slow a...
Articles from Product Experts and Googlers
Deeper Insights with knowledge engine & dataset-level metadata in BQ
In my previous blog From Data to Metadata: Unlocking Insights with Gen AI in BigQuery, we explored how BigQuery's “Insights” feature can automatically generate metadata for your tables and columns helping to uncover hidden patterns and trends within your data. We are now taking it a step further with metadata and insights generation at the dataset level. This new capability not only describes the dataset but also provides an interactive entity relationship map that visually reveals connections between different entities.
A developer's guide for building with Anthropic’s Claude 4 models on Vertex AI
We recently announced the general availability of two new models from the latest generation of Anthropic’s Claude model family on Vertex AI: Claude Opus 4 and Claude Sonnet 4. In this blog, we’ll guide you through building with the new Claude 4 models on Vertex AI.
Introducing DeepSeek R1 Model-as-a-service on Vertex AI Model Garden
Deploying Deepseek-R1-0528, a 671B parameters model, typically necessitates at least 8x H200 GPUs for a single API request. Such extensive resources are not accessible to everyone.To make Deepseek R1 more accessible to developers, we're excited to announce that DeepSeek R1 is now available as a fully managed API on Vertex AI in Preview.
