Accessing Dataplex entry for a bigquery table from bigquery UI

[vzugadi]

From BigQuery UI I can access dataplex lineage, data profile and quality scans but I cannot directily open the entry associated to the table in the data catalog if I need to access the overvue or tags added to the table or to the schema entries.

[ms4446 · Accepted solution]

Unfortunately, you can't directly open the full Dataplex entry for a BigQuery table from within the BigQuery UI. This limitation arises due to the distinct roles and interfaces of BigQuery and Dataplex within the Google Cloud ecosystem. Here's a more detailed explanation and some workarounds:

Why the Limitation Exists

• Separate Services: BigQuery is optimized for data storage and querying, focusing on analytics. In contrast, Dataplex is designed for data governance, cataloging, and lifecycle management. Their functionalities complement each other, but they operate within different contexts and user interfaces.
• UI Integration: While there is some level of integration between BigQuery and Dataplex (such as viewing lineage, profiling, and quality scans within BigQuery), fully embedding Dataplex's detailed entry views (including metadata overviews and tags) directly into BigQuery's UI could potentially overwhelm users who primarily need analytical capabilities.

How to Access the Full Dataplex Entry:

• Method 1: From BigQuery's 'Data Quality' Tab

  1. Go to your BigQuery table.
  2. Click the "Data quality" tab.
  3. If data quality scans exist, click "Manage scan permissions" (or similar). This will open Dataplex.
  4. Find your table's full entry within Dataplex.

• Method 2: Directly Access Dataplex

  1. Go to the Dataplex console: https://console.cloud.google.com/dataplex
  2. Locate the appropriate Lake and Zone where your BigQuery table is cataloged.
  3. Search for the table to find its full entry.

In the Dataplex Entry, You'll Find:

• Overview: Metadata, descriptions, and tags.
• Schema: Detail view of columns, data types, descriptions, and tags.
• Lineage: Data flow visualization.
• Data Quality: Results of configured scans.

Key Points:

• Permissions: Ensure you have 'Dataplex Data Viewer' or similar permissions.
• Setup: Your BigQuery dataset needs to be integrated with a Dataplex Lake and Zone for full cataloging.