Influence Looker’s Roadmap and join the BI Customer Council (BICC)
Would you like to influence Google Cloud’s BI roadmap more? I’d like to invite you to join the Google Cloud BI...
Data Analytics
Want more from your data? Have questions about products like BigQuery, Dataflow, or Pub/Sub? You're in the right place. Join conversations around data warehouse modernization, streaming analytics, business intelligence, and more.
Focused on Looker? Engage with the Looker Community here.
Focused on Looker? Engage with the Looker Community here.
Forum Posts
Cron Job Scheduler no longer accepts range values
Greetings!This morning I went to update a schedule for a workflow configuration and was met with an error that...
“Message Rejected” message in bulk emails
We are using the Gmail API + mailR (https://www.rdocumentation.org/packages/mailR/versions/0.8) to send out em...
Dataform ETLs too slow when run from Airflow
Hello,I'm having two problems when running Dataform ETLs from Airflow. For example, when running an ETL locall...
BQ Table partition data got deleted fully even though 'spark.sql.sources.partitionOverwriteMode' is
We have a date (DD/MM/YYYY) partitioned BQ table. We want to update a specific partition data in 'overwrite' m...
Gads transfer to BigQuery missing Pmax data
Hi, I am having issue when loading data from Google Ads to BigQuery via the official connector (data transfer)...
Ingestion from pubsublite to GCS never works
I'm following the code example herehttps://cloud.google.com/pubsub/lite/docs/samples/pubsublite-spark-streamin...
Javascript constant is not recognized in my .sqlx file
Hello all,I have been trying to figure out this error message below. I am following the Dataform documentation...
Specify schema for duplicate table dependencies.
Hello, apologies for any error, this is my first question.I have a table table_overview with a dependency to t...
GA4/BigQuery: Ignore Referrer Set to TRUE even for Non-Direct Session Sources
In GA4, we are seeing both session_start events and sessions in general have the ignore_referrer parameter set...
Can't import search console data in Big Query
Background:-Our client has enabled a GA4 parameter.-The webmaster has granted me access to Google Search Conso...
Issues with dataproc serverless connection to iceberg biglake tables
Hi all, I've been trying to connect to an Iceberg table that I created through a bigquery stored procedure. My...
Best option to synchronize DAGs in Airflow
Hello,I'm new to Airflow and am creating some DAGs that will be chained (serialized) using the TriggerDagRunOp...
Publish Data Quality Scan to Dataplex Catalog UI with Python
When I create a data scan in python, I want to publish it to the Dataplex Catalog UI interface at the same tim...
Datastream latency issue
We are facing 80 seconds of latency in Datastream Mysql to Bigquery.Reducing the binlog size configuration wil...
Local testing for cloud composer
Hello, Currently, we use cloud composer to use apache airflow (1.10.14+composer).Before we deploy our code, we...
Split table to smaller tables base on column values
Hi, I have a table with many columns: A, B, C,...How can I split my table to smaller tables which have same va...
[Feature] Referencing by alias in the same SELECT statement
SELECT 1 + 1 AS test, test * 0.85 AS test2 This is one of the biggest limitations of BigQuery at the moment, w...
Universal Analytics 360 historical export to BigQuery
https://support.google.com/analytics/answer/3416092?hl=en#zippy=%2Cin-this-articleAccording to this article:Wh...
Datastream vs Data Fusion replication
Hello!Could you explain the difference under the hood between Datastream and Data Fusion using replication job...
Timezone in BigQuery
There are lots of IDs with different timestamp and time zone information like America/New_York or Asia/Shangha...
pubsub and key rotation
Credentials to access google pubsub is rotated every month and there is an overlap of 10 days between old and ...
Conditionally trigger files/flow in Dataform based on a login
Hello Team,Is there a way for us to implement a if / else kind of mechanism in Dataform.For Example : If an as...
Subscriber’s activity not reflecting under Usage metrics Analytics Hub
HiI’ve created a listing under my exchange and added one of my friend as subscriber, but still the activity th...
BigQuery Data Transfer - Permission denied when transferring public dataset
I am trying to transfer a public dataset to our project. I am specifying a Scheduled Query with a service acco...
Pre-Commit Hook while utilizing Dataform GUI
We are attempting to implement more standardized SQL Formatting across our Dataform repositories. Most of our ...
null values in export data bigquery
I'm trying to export tables from BigQuery into a bucket in google cloud storage in JSON format. it seems that ...
Unable to Create customer expression for date
Hello All,I am trying to create the following customer expression in Looker and getting the error expression i...
Data missing in Bigquery
Hi, We enable both daily export (A full export of data, which takes place once a day) and streaming (Continuou...
Cost Related to sqldump
I need to know is there any cost implications associated with while doing sqldump to export data from mysql cl...
Pivot data in Dataform with EXECUTE IMMEDIATE statements
EDIT: I've figured out how I could do this using operations within Dataform. Article here.Hi everyone,I have a...
Articles from Product Experts and Googlers
A developer's guide for building with Anthropic’s Claude 4 models on Vertex AI
We recently announced the general availability of two new models from the latest generation of Anthropic’s Claude model family on Vertex AI: Claude Opus 4 and Claude Sonnet 4. In this blog, we’ll guide you through building with the new Claude 4 models on Vertex AI.
Introducing DeepSeek R1 Model-as-a-service on Vertex AI Model Garden
Deploying Deepseek-R1-0528, a 671B parameters model, typically necessitates at least 8x H200 GPUs for a single API request. Such extensive resources are not accessible to everyone.To make Deepseek R1 more accessible to developers, we're excited to announce that DeepSeek R1 is now available as a fully managed API on Vertex AI in Preview.
Untangle the API maze with Apigee API Hub
Mirror mirror on the wall, What do I do with my API sprawl, Where can I see them all, How to make sure they listen to my call, And to ensure their compliance doesn’t fall. API Hub is the one to rule them all!
