Get hands-on experience with 20+ free Google Cloud products and $300 in free credit for new customers.

Dataform workflow orchestration

 

I am new to dataform and i have to implement a working Dataform workflow which i have to trigger from Airflow.

Now the issue is, I have tried to implement many things described in official google documentation but there are many issues with these implementations.

 

1.Inline JS is not possible.

2.Triggering Dataform dags with specific tags and with vars.

3.Cannot import DataformWorkflowInvocationStateSensor operator in my dag code.

4.When i am trying to trigger airflow dag for dataform,it should ideally run entire compiled workspace.
I have my code inside a folder in my workspace.It is not getting triggered at all from airflow.

There are many such issues.
Please guide me to a reliable tech forum/article that i can use for implementing these scenarios.
Also,would it be better if i use dataform core instead of dataform for the same.

2 6 2,059
6 REPLIES 6