Get hands-on experience with 20+ free Google Cloud products and $300 in free credit for new customers.

Scheduling existing Dataform jobs

Hi Everyone,

I'm new to Dataform so I have a somewhat basic question. I have created some jobs in the form of sqlx files that I have no problem running manually and create BigQuery tables. However, I have an issue automating those jobs to run on a schedule. What are my options? 

What I have tried is using Workflow Configurations. I'm creating a Release Configuration but then when I create a Workflow Configuration after that stepping on it, I don't see any actions that I can list for execution. I was expecting to see the jobs created under this workspace but I get No items to display. Could the reason be that I have not integrated Dataform with Github? So the Workflow Configuration cannot use the Release Configuration, which is not connecting to git to pull the latest version of the job? Are my assumptions correct? Could I schedule jobs without GitHub integration.

Best Regards

0 1 139
1 REPLY 1

Hi @Yadela,

Welcome to Google Cloud Community!

So the Workflow Configuration cannot use the Release Configuration, which is not connecting to git to pull the latest version of the job?

You are correct regarding this, Git integration is required for automation. You can refer to this documentation for a detailed explanation of how release configuration works. 

Alternatively, you might consider submitting a feature request regarding this for enhanced functionality. Before filing, please take note on what to expect when opening an issue.

Was this helpful? If so, please accept this answer as “Solution”. If you need additional assistance, reply here within 2 business days and I’ll be happy to help.