Data at Google Cloud Next '24!
Answer this question in the comments to earn a special badge: In your journey, what's one overlooked data skil...
Forum Posts
Influence Looker’s Roadmap and join the BI Customer Council (BICC)
Would you like to influence Google Cloud’s BI roadmap more? I’d like to invite you to join the Google Cloud BI...
Dataplex Capabilities
Just kicking the tires here on Dataplex to see if it is the right fit. We are interested in its governance cap...
i can't change any organization policies.
I am trying to change the organization policy domain restricted sharing. But unfortunately I get an error ever...
Data Profile and Data Quality Scan Results not showing in UI
Hi,I am using Dataplex to run both Data profile and Data Quality scans. I want to be able to publish these res...
Accessing Dataplex entry for a bigquery table from bigquery UI
From BigQuery UI I can access dataplex lineage, data profile and quality scans but I cannot directily open the...
Dataproc Metastore not syncing metadata to Data Catalog
Hi,we have created a metastore and it has a database and table, post editing the metastore and enabling the Da...
Does GCP Data Lineage captures Lineage of Hive Tables
Hi,we're using hive tables with dataproc metastore synced to data Catalog, we could see that data catalog was ...
Dataplex quality scan rules involving more than one table
is there currently any way to define a quality rule in dataplex that involves more than one table, something l...
Policy Tags Not Appearing When Trying to Add To Column
Confirmed I have the Policy Tag Admin role but when I go to add a policy tag on a column when hitting "Edit Sc...
BQ Loader - Multiple Service Account
Dear All,I need a support to understand how I can use the following command:bq showbq loadin my shell script u...
How to identify untagged data sets
Hi,I intend to use Dataplex to tag both Big Query(BQ) Datasets and Cloud Storage(CS) Buckets in order to ident...
Usage of Data Catalog
Hi,Need some info on the below points. Please suggest.1. Can data catalog collect the actual data from Pub/ Su...
Zones from one project appearing as Big Query datasets in another project
Hi,I am using Dataplex under one project ("Project A") and have created "zones" against which big query datase...
Capturing and extracting code from BigQuery Lineage using Lineage REST API
I'm successfully automatically capturing lineage from BigQuery and I'm able to see the SQL code in the lineage...
Are Google's Categories in its Google Trends Report Available to the Public?
Hello, I am interested in the top 25 "Rising" search queries in the UK for the "Food & Drink" category, as dis...
Insufficient Authentication Scope - Google Analytics 4
I have followed this tutorial - https://developers.google.com/analytics/devguides/reporting/data/v1/quickstart...
Dataplex tag templates:cannot make tag "required"
Hi,I am editing tag templates in Dataplex but I am unable to tick the option to make the field required.I am a...
Google Drive API: problem accessing Revisions List by using Google Service Account
When I read:https://developers.google.com/drive/api/reference/rest/v3/revisions/listand try this call right on...
Create dashboard from cloud logs
i have some dataproc batch (serverless) jobs which read data from gcs and write to bigquery. In my job i am ca...
Cannot see BigQuery preview tab when table has policy tags
Hello, we have policy tags defined on some of our tables. They work as expected, users with masked reader perm...
Create table with upload file and schema fails without reason
Hi there,I am new to BigQuery, all my files are CSV files with a simple schema:DateTime:TIMESTAMP,Mth_yr:STRIN...
Dataplex metadata in BigQuery
I need to read Dataplex metadata in BigQuery to perform data analysis on the Catalog, is it possible?
Dataform external configuration
Hello everyone,My team is grappling with the challenge of scaling our Dataform code both robustly and as autom...
Policy tags in Bigquery
There is case where we mask data in one column in a table and we don't mask the same column in other table.so ...
How can i run multiple queries in dataflow template?
I am performing MSSql to bigquery data pipeline job using jdbc to bigquery template in dataflow.Since, I'm wor...
Are there GKE cost allocation labels for pods, nodes, workloads, and annotation?
I've enabled GKE cost allocation to get detailed information about my cluster costs into my Cloud Billing Bigq...
Remove subscription of listing with api Analytics hub
Hello everyone! I've been working with analytics hub API to manage the subscribers of my listings, at first I ...
is it possible to list all the columns a user can access in bigquery table.
Is it possible to list all the columns a user has access(read, write, update) to in bigquery table? for exampl...
data catalog api
Hi All, Is there any API available to download the data catalog information into a report suite and then displ...
Data Analytics Tools
Hey there! So, really, this is a general question, but what tools do any of you use for data analysis, and how...
Dataflow SQL Editor not working
When I navigate to the Dataflow SQL Workspace I expect to see a list of all my schemas on the left and a place...