Solved: Re: Dataplex - Dataquality scan - hourly

covaikumar99 · 02-21-2025 08:15 AM

My requirement is to run a data quality check every hour. There is an option to configure the check hourly, but it does not work. I tried custom CRON, but it clearly says minimum it has to be 6 hours between each run.

Anyone was in same situation and resolved this ?

marckevin

Hi @covaikumar99,

Welcome to Google Cloud Community!

You are correct, Dataplex DataScan currently has a minimum scheduling interval of 6 hours. For more frequent scans (like hourly), a workaround is to perform an on-demand scan and use the RunDataScan API to initiate the scan.

Was this helpful? If so, please accept this answer as “Solution”. If you need additional assistance, reply here within 2 business days and I’ll be happy to help.

View solution in original post

marckevin

Hi @covaikumar99,

Welcome to Google Cloud Community!

You are correct, Dataplex DataScan currently has a minimum scheduling interval of 6 hours. For more frequent scans (like hourly), a workaround is to perform an on-demand scan and use the RunDataScan API to initiate the scan.

Was this helpful? If so, please accept this answer as “Solution”. If you need additional assistance, reply here within 2 business days and I’ll be happy to help.