Influence Looker’s Roadmap and join the BI Customer Council (BICC)
Would you like to influence Google Cloud’s BI roadmap more? I’d like to invite you to join the Google Cloud BI...
Data Analytics
Want more from your data? Have questions about products like BigQuery, Dataflow, or Pub/Sub? You're in the right place. Join conversations around data warehouse modernization, streaming analytics, business intelligence, and more.
Focused on Looker? Engage with the Looker Community here.
Focused on Looker? Engage with the Looker Community here.
Forum Posts
Dataform different sources one target name
HelloMy team and I want to create a process where a target table gets data from several sources.All sources an...
Darshan Hiranandani :Error While Accessing or Creating GSheet Linked Tables -API Key Not Valid Issue
Hi everyone,I'm Darshan Hiranandani, I’ve been encountering an issue across multiple projects and tables since...
Replicating data from MySQL to BigQuery using Dataflow template
Hello BQ users! We recently published a step by step guide, which walks through how to set up data replication...
GA4>BQ streaming export, users_ table missing rows
Hi there,Until June 18 - streaming export creates events_, pseudo- and users_ tables as intended, no differenc...
Syntax error: Unexpected keyword WHERE at [5:1], Syntax error: Unexpected keyword WHERE at [4:1]
I enrolled for Google Data Analytics and started learning Google Query. In my queries, I keep having syntax er...
ReadFromBigQuery dinamically Apache Beam - Dataflow
I have a list of bigquery queries("SELECT JSON_CONTENT FROM project_id.ds.TB_1","SELECT TRANSACTION_ID FROMpro...
DCF using SQL (share & help needed)
Hi all,I'm not sure how many people will see this page but just wanted to share my SQL project related to disc...
How to Trigger a Retry in PubSub When Using Push Subscriptions
I have a google cloud function that is subscribed to a pubsub push-type subscription. Because of the setup, th...
Creating Composer 1 with Terraform fails
Hello. I'm getting this error when I'm trying to create a Composer 1 env with terraform.Error: Error waiting t...
Xxx,xxx finical reports
I'm confused on why I'm trying to do a deep comprehensive report and it's coming up as xxx and not giving me e...
Different values after dataform tables run with full refresh
I have encountered a strange issue with dataform, whereby a full refresh of the pipeline results in slightly d...
Getting roles and principals from bigquery table.
Hi,I'm trying to get all roles and principals in each one of my tables, like when in console access the link s...
Data reference from one sheet to another
In the attached sheet, I want to list info on the Pitches tab to the corresponding section on the Rolling Agen...
Policy Tags Not Appearing When Trying to Add To Column
Confirmed I have the Policy Tag Admin role but when I go to add a policy tag on a column when hitting "Edit Sc...
Looker dashboard for Firebase web app with BigQuery
Hello!I need to build a Looker dashboard for a script that was built with Firestore as part of a Firebase proj...
Billing bytes changes if insert into table
I have a select that, alone, is billing 1.61 GBHowever, if I insert the data into a table, it jumps to 22.65GB...
Looker Studio Report Not Updating with Changes in Connected Excel File
I have created a Looker Studio report that is connected to an Excel file as the data source. However, I'm enco...
DELETE/UPDATE/MERGE DMLs are currently not supported over tables that had UPSERT streams.
Hi , i am working on migrating data from rds to bq using datastream. and after the load has been completed i a...
PubSub to Dataproc Serverless
Is it possible to read events from GCP Pub/Sub (not Lite) using Spark (Structured Streaming) in Dataproc (Serv...
How to really stop a DAG from running on startup
Hello,We use Airflow on a daily basis but everything runs in a few hours during the morning. After everything ...
Kafka to BigQuery dataflow flex template doesn't migrate key
HiI'm trying to migrate Kafka JSON messages to BigQuery, including Kafka `key` value. I'm following docs here:...
Declare information_schema to multiple projects as a source in Dataform
Hi all,We are wanting to create a Dataform model that combines all of the BigQuery INFORMATION_SCHEMA.JOBS dat...
Reusable Cluster between pipelines not working
I have two Data Fusion pipelines that replicate data from MySQL table to BigQuery tables. The second pipeline ...
Logs for Connected Sheets are not recorded in BigQuery INFORMATION_SCHEMA
I have the following questions regarding Connected Sheets and BigQuery:•When connecting Google Sheets to BigQu...
Missing Schema - CCAI insights Export
I used conversational Insights API to export insights data to BigQuery:POST https://contactcenterinsights.goog...
Darshan Hiranandani - Unable to Verify Payment Card for Cloud Free Tier?
Hi everyone,I'm Darshan Hiranandani, trying to sign up for the Cloud Free Tier to use BigQuery, but I’m runnin...
Data Flow implementation with Flex
I'm trying to build Data FLow job to read and write data to Big Table. Job is always fails on:Timeout in polli...
Dataflow Pubsub Proto to Bigquery with Struct
Hello, Im working with the dataflow streaming flex templates documented here: https://cloud.google.com/dataflo...
Unable to trigger cloud function based on dataflow success event
I am using the google provided template 'text on gcs bucket to bigquery' to move some ndjson files from cloud ...
Pub/Sub PUBLISH_PERMISSIONS_MISSING_FOR_PUBSUB_TOPIC
We're managing multiple customers with google my business. We would like to get notified from google if a new ...
Articles from Product Experts and Googlers
A developer's guide for building with Anthropic’s Claude 4 models on Vertex AI
We recently announced the general availability of two new models from the latest generation of Anthropic’s Claude model family on Vertex AI: Claude Opus 4 and Claude Sonnet 4. In this blog, we’ll guide you through building with the new Claude 4 models on Vertex AI.
Introducing DeepSeek R1 Model-as-a-service on Vertex AI Model Garden
Deploying Deepseek-R1-0528, a 671B parameters model, typically necessitates at least 8x H200 GPUs for a single API request. Such extensive resources are not accessible to everyone.To make Deepseek R1 more accessible to developers, we're excited to announce that DeepSeek R1 is now available as a fully managed API on Vertex AI in Preview.
Untangle the API maze with Apigee API Hub
Mirror mirror on the wall, What do I do with my API sprawl, Where can I see them all, How to make sure they listen to my call, And to ensure their compliance doesn’t fall. API Hub is the one to rule them all!
