Solved: Usage of Data Catalog - Page 2

Nigal · 02-05-2024 06:29 AM

Hi,

Need some info on the below points. Please suggest.

1. Can data catalog collect the actual data from Pub/ Sub topics ? Or it can be just used to collect only the metadata of Pub/Sub topics.
2. Data catalog refers collecting two kinds of metadata namely business and technical metadata. Can you give some insights on both with some examples.

Thanks.

ms4446

The process of collecting detailed metadata like column names and data types from Pub/Sub topics indirectly involves the data being ingested into a structured storage or processing service (like BigQuery) where a schema can be applied. Data Catalog then collects metadata from these services, not directly from Pub/Sub topics. This integration across Google Cloud services enables a comprehensive approach to data management and metadata cataloging, enhancing discoverability and governance of data assets.

View solution in original post