Bigquery Logs

[sharontmathew]

Is there a way to check the history of changes made to a particular schedule query.
I am able to see the creator of schedule query for the logs explorer, but how can we check who is enabling or disabling the schedule query ?

[ms4446]

While Google Cloud BigQuery doesn't offer a dedicated feature specifically for tracking changes to scheduled queries, Cloud Audit Logging serves as an effective tool for monitoring and auditing these changes. This process involves utilizing existing Cloud Audit Logs and possibly setting up additional logging configurations.

Enabling Cloud Audit Logging for BigQuery:

1. Navigate to IAM & Admin > Audit Logs in the Google Cloud Console.
2. Click "Create Audit Log Sink" if you need to export logs for long-term storage or specific analysis.
3. Select "BigQuery" as the resource type.
4. Choose the project and dataset where you want to store the audit logs.
5. Under "Log entries to include," it's recommended to select "Admin activities." Optionally, select "Data access and modifications" for more detailed logging, but be mindful of the potential volume and associated costs.
6. Click "Create sink" to complete the setup.

Viewing Audit Logs for Scheduled Queries:

1. Access the Logs Explorer in the Google Cloud Console.
2. Filter logs by the BigQuery service and specify criteria to identify entries related to scheduled queries.
3. Examine log entries for details such as the user, action type, and timestamp of changes made to scheduled queries.

Permissions:

• Ensure you have the necessary permissions, like Logging/Logs Viewer or specific BigQuery roles with logging permissions, to access these logs.

Real-Time Monitoring and Alerts:

• Utilize Cloud Monitoring to set up real-time alerts based on log data. This enables proactive monitoring of changes to scheduled queries, alerting you to activities like creation, updates, or deletions.

Cloud Audit Logging in BigQuery, by default, captures most administrative actions including those related to scheduled queries. For more detailed monitoring or specific use cases, additional logging configurations can be set up. This approach provides a comprehensive solution for monitoring and auditing activities related to scheduled queries in BigQuery, encompassing log review, potential log export, and real-time alert setups.