Hi All,
At my company we are working on moving our production data from MySQL to Bigquery, however it's in a multi-tenant structure. So each customer has their own dataset (schema) and the tables are all the same unless a customer has add-on features that don't come standard. So once in BigQuery we want to leverage Dataform to create new tables for ALL customers for the common tables in each dataset. So things like the Account table or Transactions table will all be common. How can we loop through each dataset to combine these tables into one? Does anyone have documentation or has faced something similar? Any help is appreciated!
Thanks,
Aaron
LinkedIn
Twitter
