Influence Looker’s Roadmap and join the BI Customer Council (BICC)
Would you like to influence Google Cloud’s BI roadmap more? I’d like to invite you to join the Google Cloud BI...
Data Analytics
Want more from your data? Have questions about products like BigQuery, Dataflow, or Pub/Sub? You're in the right place. Join conversations around data warehouse modernization, streaming analytics, business intelligence, and more.
Focused on Looker? Engage with the Looker Community here.
Focused on Looker? Engage with the Looker Community here.
Forum Posts
BigQuery Multi-statement Queries with Temporary Functions, Console preview question
When performing multistatement queries that are preceded with a temporary function, the output window repeats ...
BigQuery - query for item performance with source / medium dimension
Hi,I've been trying for quite a while to generate a query that will give results like this:Dimension: Date, It...
Try Looker Studio Pro at no cost for 30 days
Hello,I'd like to try Looker Studio Pro. On the Looker Studio page, it states that we can try Looker Studio Pr...
GCP dataform default service account unable to access secret
Hi there! I've been trying to create a custom service account for dataform. I've given it the required roles l...
Dataplex Quality Generated Query Optimization
Hi,I am using Dataplex to execute data quality controls over my data but I am concerned about its resource con...
How to Get the Total Input Record Count in a Google DataFusion Custom Transformation Plugin?
I am developing a custom transformation plugin using java for Google DataFusion, and I need to determine the t...
Is there a way to declare sources dynamically in a separate sources.js file in Dataform?
I want to read all tables from a specific dataset in BigQuery's INFORMATION_SCHEMA.TABLES and dynamically popu...
Trino on zeppelin on dataproc
Hello.I do not have the trino interpreter in Zeppelin on Dataproc.How do I enable it?I can run trino from the ...
Dataplex Attribute store tagging to Bigquery
Hi, I have create a lake where it contains a dataset with 2 tables. Next, I have create a taxonomy in Attribut...
Using Dataform with Internal/Private GitLab Repositories
Hello Google Cloud Community,I am looking to use Dataform to execute data pipelines in my company. We use GitL...
Cloud Data Fusion Upgrade
Dear Experts,I tried to upgrade a Data Fusion instance from version 6.9.2 to 6.10.1.2 with an error returned: ...
Issue Sharing Looker Report
I am experiencing while attempting to share a Looker report with a large group of users, approximately 3,000 i...
CDC with Dataflow into BigQuery: Storage Write API doesn't respect Primary Key
I have a BigQuery table created using the following DDL:CREATE TABLE mytable AS ( id STRING, source STRING, PR...
Datastream - PostgreSQL Source and BigQuery Destination - Handling of REPLICA IDENTITY FULL
We have a self-managed PostgreSQL v10 database in which multiple tables have their replication identity set to...
Dataplex - Dataquality scan - hourly
My requirement is to run a data quality check every hour. There is an option to configure the check hourly, bu...
Airflow to Dataform call
Hi Team,I have an scenario, to call the data form workspace from airflow.I'm getting struct with assign the ri...
Dataplex Quality scan cost optimizing
Hi,I'm wondering if there's some way to configure a custom query in Dataplex's data quality scans in a cost-op...
EXECUTE IMMEDIATE ("query string")
hi everybody,I'm trying to launch the following query:DECLARE ex_table STRING;DECLARE ex_column STRING;DECLARE...
Dataflow flex template issue
I am having the issue with dataflow flext temaplete , while lauching the jobs from vertex ai kfp pipeline gett...
GSC Data Exports: BigQuery Connector vs. GSC API
Hi all & @ms4446 who likely can help here I recently compared a data export from the GSC API to the data exp...
GoogleJsonResponseException: API call to bigquery.jobs.getQueryResults failed with error: Access Den
I'm trying to get data out of bigQuery and into Google Sheet through AppScript.This works perfectly as long as...
[BigQuery] (310) Storage API Error: Error: { code: UNKNOWN, message: Stream removed } in PowerBI
I am getting this error for big projects which have large number of rows in PowerBIFailed to save modification...
Simba biquery driver not supporting different project other than billing project
Hi Folks,We are using Simba BigQuery driver for one of our integration. Based on that we have two projects one...
DataPlex DataQuality dependencies
Are there dependencies between rules in a data quality framework, such as linking one rule or dimension to ano...
Best option to implement a Data Dictionary in BigQuery
Hi Dear,I am working with BigQuery, Dataform and Dataplex Data Catalog to manage my data and metadata. I have ...
API for listing all the External Connections in a project for BigQueryI’m
Hi All,The RestAPI avaialable for listing external connections for BigQuery.https://cloud.google.com/bigquery/...
How to get Sink component success status in Data Fusion
Hi, I have a job in data fusion. Source-GCS, sink- GCS . I need to get the success status of the sink componen...
Dataplex quality scan rules involving more than one table
is there currently any way to define a quality rule in dataplex that involves more than one table, something l...
Data Fusion accelerators
Hello, no more accelerator - Replication. Checked it on 2 aacounts cant create new instance with him
Running specific sqlx files using Airflow (Composer)
Hi, I want to execute specific Dataform (sqlx) files using Airflow (Composer).I know the best practice is to t...
Articles from Product Experts and Googlers
BigQuery Data Preparation with AI Agents: Smarter, faster, and code-free
Ready to unlock the secrets hidden in your product data? This tutorial demonstrates how BigQuery Data Preparation can clean and transform your raw data into actionable business intelligence, using a realistic example from the Fashion and Beauty industry.
Launched: ABAP SDK v1.10 unleashing powerful AI/ML, eventing, and storage capabilities
Supercharge your SAP systems! ABAP SDK v1.10 unlocks BigQuery AI/ML, simplified event-driven integration, Cloud Storage content repositories & access to 290+ Google Cloud APIs. See what's new.
From idea to viral video: the GenAI workflow you need
What if you could create professional-quality videos with just a fraction of the effort? This blog introduces a radical new GenAI workflow on Vertex AI, using models like Gemini, Imagen3, MusicLM and Veo2 etc to make video creation accessible to everyone.
