Is it possible to trigger a user defined event or does Google emit an event to pub/sub when the dataset linked to standard billing export is updated / modified?
Solved! Go to Solution.
Hello @dheerajpanyam,
Google Cloud does not natively publish Pub/Sub events for billing export dataset updates, but you may build custom monitoring. The most robust approaches use Cloud Logging routed to Pub/Sub (filtering BigQuery job completions) or scheduled metadata checks via Cloud Scheduler/Workflows. While standard exports refresh daily, near-real-time tracking requires these workarounds. For implementation, prioritize Logs Router for managed simplicity or Eventarc for serverless triggers.
Key Options:
Note: Native event support is unavailable; all solutions require proactive setup.
Best regards,
Suwarna
Hi, @dheerajpanyam.
From my understanding, this isn't possible in GCP. However, you can implement similar patterns to achieve the desired result - Examples of automated cost control responses.
Regards,
Mokit
Hello @dheerajpanyam,
Google Cloud does not natively publish Pub/Sub events for billing export dataset updates, but you may build custom monitoring. The most robust approaches use Cloud Logging routed to Pub/Sub (filtering BigQuery job completions) or scheduled metadata checks via Cloud Scheduler/Workflows. While standard exports refresh daily, near-real-time tracking requires these workarounds. For implementation, prioritize Logs Router for managed simplicity or Eventarc for serverless triggers.
Key Options:
Note: Native event support is unavailable; all solutions require proactive setup.
Best regards,
Suwarna
Thanks @SuwarnaKale