Hi,
I'm new to Dataform, but have previously used dbt
- in dataform (cloud), I have a repo named "mydata"
- inside, I have workspaces named eudev and syldev
- Everything is linked to a git repo named "mydata". the workspace generate the right branches
- in the workspaces. There are SQLXs that are tagged wit eudata. these SQLX need to be executed on a schedule and run on the EU region.
- The rest of the SQLX (not tagged) needs to be run on the US (default) region
I tried using Compilation variables (set to EU/US) and then try to add that in workflow_settings.yaml like
... other workflow_settings
defaultLocation: "${variables.region}"
but I get an error
Location ${variables.region} does not support this operation.
How do I set that up in Dataform?
my goal is to have 1 repo managed data transformation across the regions, and have GCP data transfer moving the data between region for my needs
LinkedIn
Twitter
