I am migrating from Dataform web to BQ Dataform on GCP. I have created the Dataform repository, connected to my gitlab repository, created a development workspace and all are good. I have also changed what is necessary in package.json and dataform.json. I have yet to create release configurations and workflow configurations. I have a few basic questions on the next steps.
- I have schedules running on the Dataform web, which runs everyday. If I were to create release and workflow configurations, when do I run off the scheduling on Dataform web. I do not want to run both of them at the same time.
- If someone has already done the migration, how long does it take to migrate all the schedules to release and workflow configurations and get it running. I have to make sure all the configurations runs successfully BQ Dataform before I turn off the one on Dataform web.
Appreciate any advice on this migration.
LinkedIn
Twitter
