Run Dataform jobs in BATCH mode

[JaisonGJ]

We recently on boarded to Dataform and noticed the default priority mode is INTERACTIVE and it has created huge performance issues for us. Is there a way to set to BATCH mode?

[mongaa]

We figured out in our project that specifically choosing the objects to execute (in case when you can't group the objects with tags), is a very slow process, especially when you have to execute the job again and again. For us running the dataform complication/executions became much easier via the API. You can also pass on the values like running the dependencies and and dependents with the list of objects that needs to be executed.

[JaisonGJ]

Scheduling dataform jobs and managing dependency are fine but the issue is the jobs submitted to BigQuery with INTERACTIVE priority which affects the performance of our looker/data studio dashboards when the usage is high. I think the solution is to set jobs submitted via dataform to have an option to run in BATCH mode within SQLX configuration or at project level.