Influence Looker’s Roadmap and join the BI Customer Council (BICC)
Would you like to influence Google Cloud’s BI roadmap more? I’d like to invite you to join the Google Cloud BI...
Data Analytics
Want more from your data? Have questions about products like BigQuery, Dataflow, or Pub/Sub? You're in the right place. Join conversations around data warehouse modernization, streaming analytics, business intelligence, and more.
Focused on Looker? Engage with the Looker Community here.
Focused on Looker? Engage with the Looker Community here.
Forum Posts
Looker Aggregate Awareness requires the date filter to be exactly the same, which is weird
I have a table with a daily metric, and now I want to add aggregate awareness to have weekly metrics handy. Be...
GitLab and Dataform integration - wrong commiter's e-mail address
The following setting has to be turned off in GitLab repo in order to enable Dataform’s workspaces git integra...
Issue Passing Dynamic Variables CSV from Shell Script into Dataform (v2.6.7)
Hi Dataform Community,I'm encountering issues dynamically passing variables (specifically dataset names) from ...
BQ dataset - Google Ads Transparency Center
Hello,I'm just thinking how to correctly present data I got from this BQ extract. Especially I mean table publ...
Dataform Run Doesn't work with CI/CD
Hello @ms4446 I have installed Dataform on my local machine(WSL) and ran the dataform deployments to GCP, ever...
Problem with partitioned table in BigQuery and streaming buffer from Datastream
Hello,I have created a datastream from MySql to BigQuery, a made table in Bigquery partitioned.It looks like i...
Push Data from Big Query to Cloud SQL
Hi Team, I want to push Data from Big Query to Cloud SQL in batch mode.Please suggest me the simplest way to d...
Composer workers are restarting frequently
@pgstorm148 I am using composer-2 [ composer-2.8.5-airflow-2.7.3 ] version in which i am running min= 2 schedu...
Migrating Data from Big Query to S3 Buckets using AWS Glue
Trying to migrate data from Big Query to S3 bucket using AWS glue but not able to configure the connection pro...
Dataform remove CREATE SCHEMA IF NOT EXISTS
Hi everyone,I'm new to Dataform technology and I need your support to understand if I'm doing something wrong....
Actions cannot resolve operations which do not produce output.
Hi Community folks,I've got some complex logic in definitions/javascript file that iterates through a list of ...
YouTube analytic
I have two Query .1. How can add multiple YouTube channel data at once Loocker Studio?2. How can I add YouTube...
Potential solutions for exporting GA4 raw data from BQ to Snowflake(When GA4 raw data loaded in BQ)?
Hi there,I am looking for some advice here. I thought of the following solutions for exporting GA4 raw data fr...
Convert Timestamp from UTC to PST
Hi Everyone, I am using data fusion to extract data which is loaded into BigQuery. From the source table, the ...
BigQuery billing discrepancy - JOBS table vs Billing report
Hello GCP community,I am using BigQuery on-demand pricing, and I want to find details about jobs and their cos...
Dataform test cannot see the dataset. But the dataset is actually exist.
To make the question simple. I create a dataset call test_dataset. And I can see it inside Bigquery after I cr...
Dataproc PySpark Job Fails with "Failed to find data source: pubsub
I am running a PySpark streaming job on Google Cloud Dataproc to read data from Pub/Sub and write it to BigQue...
Dataform Random Action Failure
Issue: I'm getting an execution failure near the end of my scheduled dataform workflow from time to time and I...
How to remove an aspect type from entry in Dataplex Catalog [Python SDK]
Hello, I'm migrating some python workloads from Data Catalog to Dataplex catalog and I'm struggling with autom...
Dataform backfill for daily and historic snapshot tables
Hi there,We are currently evaluating how to migrate our analytics setup from Scheduled Queries to a Dataform r...
Issue with looker studio Dashboard
I have created a calculated field and a parameter in looker studio, to filter my data based on options 12 mont...
Multitable Database Tables
Hi,I am using the Multitable Database Table plugin to load tables from Oracle to BigQuery. The pipeline works ...
Can not Upgrade the composer Version 2
I have noticed from few days that I am not getting to UPGRADE Composer 2 image version. During my finding i fo...
UDFs in Python for BigQuery
Does BigQuery supports UDFs in Python ?
Is there a fee to retrieve data with the BigQuery API or BigQuery Storage Read API?
I am currently developing a function to retrieve data from a BigQuery table on a local server set up using Go....
Hey, I am Haley
I join anything involving data. I'm hacked. Bad. I'll just listen.
Dataform import json config
HiI'm having trouble importing configurations into my sqlx. I created the dataform_cofig.json file {"database"...
Looker - key inputs
Hi TeamI am planning to use key inputs feature in looker studio pro. I want to store this value in some place....
Dataplex - Email alert on job failure - needs to happen once - incremental scope
Dear TeamAny inputs on the below would be highly appreciated? we have set the below things in our scanscope in...
Filtering Big Query view with partition column
Hello.I have a case where I need to filter data using a view and a partition column.Table:CREATE TABLE `testin...
Articles from Product Experts and Googlers
Untangle the API maze with Apigee API Hub
Mirror mirror on the wall, What do I do with my API sprawl, Where can I see them all, How to make sure they listen to my call, And to ensure their compliance doesn’t fall. API Hub is the one to rule them all!
Next-Gen Data Pipelines: Airflow 3 Arrives on Google Cloud Composer
We are thrilled to announce that Google is the first hyperscaler to provide selected customers with access to Apache Airflow 3 on our fully managed Cloud Composer 3 service. Discover how powerful new features like DAG Versioning, a modern React-based UI, and scheduler-managed backfills can help you innovate faster and more reliably.
Configuring GKE rollout sequencing
You can manage the order of automatic cluster upgrades across Google Kubernetes Engine (GKE) clusters in multiple environments using rollout sequencing. For example, you can qualify a new version in pre-production clusters before upgrading production clusters.
