Apart from usual data transformations, I found myself in need to create data automatically. Mostly it revolves around GDPR compliance and creating AEAD keys for new incoming data. dbt can't handle this as it would require an incremental insert and sometimes an update/delete.
Any suggestions what's the best way to solve it? At first I thought git repo (a must) with operational queries and use either Cloud Workflows or Scheduled Queries. Perhaps there are better ways?
LinkedIn
Twitter
