Get hands-on experience with 20+ free Google Cloud products and $300 in free credit for new customers.

DataPlex DataQuality dependencies

Are there dependencies between rules in a data quality framework, such as linking one rule or dimension to another? How should these interdependencies be managed?

@ms4446 

Please Help me with this Requirement 

0 1 67
1 REPLY 1

Hi @Ramesh122,

Welcome to Google Cloud Community!

This may happen depending on how you set your rules in a data quality scan. For instance, you have a table named customer_table that includes an email field. First, you need to ensure if the field is not null before checking the email formats.

Here are some approaches for best practices in managing rules in data quality:

  • Leverage data profiling and custom rule creation to analyze your data more effectively.
  • To schedule data quality checks you can use Dataplex API through workflow orchestration like Cloud composer for complex data quality scenarios.

For more detailed information, you can use Cloud Logging to quickly identify potential root causes of data quality issues.

Was this helpful? If so, please accept this answer as “Solution”. If you need additional assistance, reply here within 2 business days and I’ll be happy to help.