This website uses Cookies. Click Accept to agree to our website's cookie use as described in our Privacy Policy. Click Preferences to customize your cookie settings.
Accept
Reject
Preferences
Log in to ask a question
Log in to ask a question
DataEngineer
Bronze 5
Bronze 5
Since ‎05-10-2023
Monday

My Stats

  • 23 Posts
  • 2 Solutions
  • 19 Likes given
  • 19 Likes received

DataEngineer's Bio

Badges DataEngineer Earned

View all badges

Recent Activity

Cloud Alerting email notifications have changed and no longer include Log Match Conditions.

01-29-2024
I have several alerting policies set up to monitor BigQuery and they send email notifications when fired.On Wednesday Jan 24th the formatting of the email notification changed and log match conditions are no longer being included in the body of the e...

Can you make built-in assertions a dependency instead of a dependent?

01-23-2024
When Dataform was first released as General Availability, built-in assertions (uniqueKey, nonNull,...) were actually run in a workflow as dependencies to whatever table they were attached to and run before the table was built.At some point in the rec...

Querying a view that references another view returns no records.

11-22-2023
I have a view that compares a table to a different view. If I run the SQL (on the right) that comprises the view, I get the expected record output. Now if I SELECT * the view itself (on the left), no data is returned.I have troubleshooted this by mat...

[Dataform] How to create an incremental table with a list of columns pulled from INFORMATION_SCHEMA?

10-05-2023
Use case:We have a table `aggdata.locations` that is frequently being updated with new columns.We want to be able to capture this table with weekly snapshots using an INCREMENTAL table in dataform.Issue:The problem that arises in the use of SELECT * ...

Dataform - additional learning

05-10-2023
Dataform just recently went into General Availability. My team is looking to move our transformations away from scheduled queries and into Dataform workflows. Outside of the GCP documentation, are there any additional resources to learn how to utiliz...