Notification when a Big Query Data Set or Cloud Storage Bucket is created

[Beginner]

I want to use Dataplex to label and categorise Big Query Data Sets and Google Cloud Storage buckets across several projects. How can I be notified whenever a new Big Query Data Set or Cloud Storage bucket is created under any of these projects? (so that I can apply the appropriate label). Is this possible?

[marckevin · Accepted solution]

Hi @Beginner,

Welcome to Google Cloud Community!

Alert and Notification for Dataplex tasks is intended to monitor failed job executions, a process already handled by Dataplex which doesn't trigger directly on the creation of a new dataset or bucket.

Here are possible suggestions that you can try:

• Cloud Logging with filtered events and use the Cloud Run function as trigger.
• Leverage Eventarc, which subscribes events to BigQuery Dataset and Cloud Storage bucket creation and configures it to trigger a Cloud Run function.

Was this helpful? If so, please accept this answer as “Solution”. If you need additional assistance, reply here within 2 business days and I’ll be happy to help.