Influence Looker’s Roadmap and join the BI Customer Council (BICC)
Would you like to influence Google Cloud’s BI roadmap more? I’d like to invite you to join the Google Cloud BI...
Data Analytics
Want more from your data? Have questions about products like BigQuery, Dataflow, or Pub/Sub? You're in the right place. Join conversations around data warehouse modernization, streaming analytics, business intelligence, and more.
Focused on Looker? Engage with the Looker Community here.
Focused on Looker? Engage with the Looker Community here.
Forum Posts
Dataproc Hive: Auto reconnect is not allowed for this connection
I am facing below error while running tableau prep workflow which is connecting to hive on Dataproc."System er...
At least one action must be selected for execution" in DataformCreateWorkflowInvocationOperator
Dear Google Cloud Community,I hope this message finds you well.I am encountering an issue while using the Data...
Looker Aggregate Awareness requires the date filter to be exactly the same, which is weird
I have a table with a daily metric, and now I want to add aggregate awareness to have weekly metrics handy. Be...
GitLab and Dataform integration - wrong commiter's e-mail address
The following setting has to be turned off in GitLab repo in order to enable Dataform’s workspaces git integra...
Issue Passing Dynamic Variables CSV from Shell Script into Dataform (v2.6.7)
Hi Dataform Community,I'm encountering issues dynamically passing variables (specifically dataset names) from ...
BQ dataset - Google Ads Transparency Center
Hello,I'm just thinking how to correctly present data I got from this BQ extract. Especially I mean table publ...
Dataform Run Doesn't work with CI/CD
Hello @ms4446 I have installed Dataform on my local machine(WSL) and ran the dataform deployments to GCP, ever...
Problem with partitioned table in BigQuery and streaming buffer from Datastream
Hello,I have created a datastream from MySql to BigQuery, a made table in Bigquery partitioned.It looks like i...
Push Data from Big Query to Cloud SQL
Hi Team, I want to push Data from Big Query to Cloud SQL in batch mode.Please suggest me the simplest way to d...
Composer workers are restarting frequently
@pgstorm148 I am using composer-2 [ composer-2.8.5-airflow-2.7.3 ] version in which i am running min= 2 schedu...
Migrating Data from Big Query to S3 Buckets using AWS Glue
Trying to migrate data from Big Query to S3 bucket using AWS glue but not able to configure the connection pro...
Dataform remove CREATE SCHEMA IF NOT EXISTS
Hi everyone,I'm new to Dataform technology and I need your support to understand if I'm doing something wrong....
Actions cannot resolve operations which do not produce output.
Hi Community folks,I've got some complex logic in definitions/javascript file that iterates through a list of ...
YouTube analytic
I have two Query .1. How can add multiple YouTube channel data at once Loocker Studio?2. How can I add YouTube...
Potential solutions for exporting GA4 raw data from BQ to Snowflake(When GA4 raw data loaded in BQ)?
Hi there,I am looking for some advice here. I thought of the following solutions for exporting GA4 raw data fr...
Convert Timestamp from UTC to PST
Hi Everyone, I am using data fusion to extract data which is loaded into BigQuery. From the source table, the ...
BigQuery billing discrepancy - JOBS table vs Billing report
Hello GCP community,I am using BigQuery on-demand pricing, and I want to find details about jobs and their cos...
Dataform test cannot see the dataset. But the dataset is actually exist.
To make the question simple. I create a dataset call test_dataset. And I can see it inside Bigquery after I cr...
Dataproc PySpark Job Fails with "Failed to find data source: pubsub
I am running a PySpark streaming job on Google Cloud Dataproc to read data from Pub/Sub and write it to BigQue...
Dataform Random Action Failure
Issue: I'm getting an execution failure near the end of my scheduled dataform workflow from time to time and I...
How to remove an aspect type from entry in Dataplex Catalog [Python SDK]
Hello, I'm migrating some python workloads from Data Catalog to Dataplex catalog and I'm struggling with autom...
Dataform backfill for daily and historic snapshot tables
Hi there,We are currently evaluating how to migrate our analytics setup from Scheduled Queries to a Dataform r...
Issue with looker studio Dashboard
I have created a calculated field and a parameter in looker studio, to filter my data based on options 12 mont...
Multitable Database Tables
Hi,I am using the Multitable Database Table plugin to load tables from Oracle to BigQuery. The pipeline works ...
Can not Upgrade the composer Version 2
I have noticed from few days that I am not getting to UPGRADE Composer 2 image version. During my finding i fo...
UDFs in Python for BigQuery
Does BigQuery supports UDFs in Python ?
Is there a fee to retrieve data with the BigQuery API or BigQuery Storage Read API?
I am currently developing a function to retrieve data from a BigQuery table on a local server set up using Go....
Hey, I am Haley
I join anything involving data. I'm hacked. Bad. I'll just listen.
Dataform import json config
HiI'm having trouble importing configurations into my sqlx. I created the dataform_cofig.json file {"database"...
Looker - key inputs
Hi TeamI am planning to use key inputs feature in looker studio pro. I want to store this value in some place....
Articles from Product Experts and Googlers
Simplify your compliance and security with assured workloads for Google Cloud NetApp Volumes!
We are thrilled to announce a significant enhancement to Google Cloud NetApp Volumes with the integration of Assured Workloads. This powerful combination empowers organizations to deploy NetApp Volumes in a rigorously secure and controlled environment, specifically designed to meet the stringent compliance demands of highly regulated sectors such as government, healthcare, and financial services.
BigQuery Data Preparation with AI Agents: Smarter, faster, and code-free
Ready to unlock the secrets hidden in your product data? This tutorial demonstrates how BigQuery Data Preparation can clean and transform your raw data into actionable business intelligence, using a realistic example from the Fashion and Beauty industry.
Launched: ABAP SDK v1.10 unleashing powerful AI/ML, eventing, and storage capabilities
Supercharge your SAP systems! ABAP SDK v1.10 unlocks BigQuery AI/ML, simplified event-driven integration, Cloud Storage content repositories & access to 290+ Google Cloud APIs. See what's new.
