Influence Looker’s Roadmap and join the BI Customer Council (BICC)
Would you like to influence Google Cloud’s BI roadmap more? I’d like to invite you to join the Google Cloud BI...
Data Analytics
Want more from your data? Have questions about products like BigQuery, Dataflow, or Pub/Sub? You're in the right place. Join conversations around data warehouse modernization, streaming analytics, business intelligence, and more.
Focused on Looker? Engage with the Looker Community here.
Focused on Looker? Engage with the Looker Community here.
Forum Posts
Bq export in parquet format
I want to export the bigquery data to GCS using bq extract command. As per the documentation, it supports the ...
Google Ads data transfer in bigquery: missing secondary goal conversions?
Hi, I noticed that no table has the secondary conversion metrics set; I can only see the primary conversions. ...
Cross Project Data Sources Lineage in Dataplex
Hi Team,I just want to understand , is it possible to create lineage using Dataplex for the BQ tables which ar...
Missing events_ table in BQ/Firebase link
Hello, dear community!I linked Firebase to BQ 9 days ago I use BigQuery streaming export.So far I have only 3 ...
DataForm - Help Needed with Reading Schema from JSON for Table Creation
Hi everyone,I’m currently working on a project where I need to create a table in GCP BigQuery. My goal is to r...
Terraform Ignore_Changes on PolicyTags in BigQuery
We are using Terraform for our IaC -- to build datasets, tables...etc. Our BigQuery Row and Column level Secur...
Saving analytics directly to BigQuery
When I read about loading data to a data warehouse, people usually mention saving the events in a cloud storag...
Setting writeDisposition to "WRITE_TRUNCATE" when using the Storage Write API (Pending mode) in Java
Hello,I'm developing a custom tool with Java for writing data to BigQuery. This tool sends data to the Storage...
writeDisposition WRITE_TRUNCATE with the bigquery storage write API
I want to use the BigQuery Storage Write API with Pending mode, but when I do BatchCommitWriteStreamsI want to...
HTTP Plugin : API Key Authentication Issue
Hi Team, I need to connect to an endpoint using an API Key.When I use the following curl command, it works per...
Dataform - dynamic name of the dataset
Hello everyone,I need help with Dataform. I have been using JS file for storing variables, one of them is data...
Best way to add query labels to a model in dataform
Hi there,As analytics engineers, we want to be able to tag our dataform queries by the layer and domain so tha...
How to use an installed public package in Dataform?
I installed this package in dataform successfullyhttps://www.npmjs.com/package/libphonenumber-jsThis is how it...
Bigquery Partitioning with Looker front end
We have a table that has streaming data of a few hundreds of MBs of data coming in everyday. This table is par...
Define list of string form query results to use in loop operation
Hi, I wanted to do this looping in dataform .sqlx file: js { const tables = [ 'table1', 'table2', 'table3' ]; ...
BigQuery - Source Platform GA4 Dimension
I am trying to figure out how to get the GA4 dimension, "source platform" in my Big Query exports. Upon my res...
Terraform Ignore_Changes on PolicyTags in BigQuery
We are using Terraform for our IaC -- to build datasets, tables...etc. Our BigQuery Row and Column level Secur...
Terraform Ignore_Changes on PolicyTags in BigQuery
We are using Terraform for our IaC -- to build datasets, tables...etc. Our BigQuery Row and Column level Secur...
Refresh Looker Studio Monthly instead of daily
Is there a way to refresh Looker Studio data from my Azure database monthly instead of daily to limit costs? D...
Refresh Data Monthly instead of daily
I have a Looker Studio report that is connected to my Azure database. I want to refresh the data monthly at th...
Using disabed config in dataform
Hi team, Problem: I've got some really big tables that I don't want my models to be building daily, only durin...
BigQuery 503 backendError
Getting an error when inserting into BigQuery from Snowplow scala app. The status page is not showing any outa...
Dataform: Cannot select single action when having same table in different datasets
Hi, I'm encountering an issue when trying to execute an action in Dataform for a specific table that exists in...
BQ query speed in recent weeks?
Hello - so I've been using BQ to query a few-hundred-GB dataset for a few years now. Data is constantly insert...
Dataflow using dynamic input
Hello, I am creating a dataflow pipeline using java that will read from BQ and then insert the data into a mys...
Can't Access Airflow Database After Composer Update
In the past, I used the instructions found in https://cloud.google.com/composer/docs/composer-2/access-airflow...
Dataform - handling duplicate table names
This feels like something I've overlooked, but I'm having trouble with two tables that have the same name. I h...
Cloud Composer - Task is throttled
import re from datetime import datetime # airflow imports from airflow.decorators import dag, task from airflo...
Data fusion replication is unable to connect to mysql database
Hello,I successfully managed to connect to my mysql db using the wrangler.When I try to create a replication j...
[dataform] egress IP fixed ranges
Hello, We would like to connect our Dataform repository to an on-premise GitLab repository located behind fire...
Articles from Product Experts and Googlers
Protect your LLM applications with Google Cloud Services
Generative AI offers immense power, but with it comes significant risk. This article discuss how to protect your LLM applications from prompt injection, data leakage, and other threats using a multi-layered security approach with Google Cloud services like Natural Language API, Model Armor, and vector databases.
Evaluating success in a multi-agent system: Why trajectory assessment and handoffs matters
Your AI agents are only as good as their ability to collaborate. As we move from single agents using tools to multi-agent ecosystems, our methods for evaluating success must evolve. Learn why trajectory and handoffs matter more than ever.
Media CDN flexible origin shielding: Reducing origin load, latency, and improving viewer experience
Discover how Media CDN's new flexible origin shielding enhances content delivery! Learn how to reduce origin load, optimize latency, and improve viewer experience by precisely controlling your shield locations.
