Trigger dataform workflow when a commit is merged in main

[knight_m]

Hello Community,

Is there a way to trigger the workflow config in dataform only when a commit is merged in the master branch of my git provide ?

Do let me know if there is any other ways around the same.

Many thanks

[NorieRam · Accepted solution]

Hi @knight_m,

Welcome to Google Cloud Community!

Currently, Dataform doesn’t natively support triggering workflows directly from Git merge events. However, you can achieve this by using a CI/CD system like GitHub Actions or any other similar service as an intermediary.

Here's how it works:

• Set up a CI/CD pipeline that listens for merges to your main branch.
• Once a merge happens, the CI/CD pipeline will trigger a dataform run command to execute your Dataform workflow.
• The CI/CD system can securely handle authentication and store credentials, allowing the Dataform workflow to run with the necessary permissions.

For more information, refer to:

• Dataform CLI
• CI/CD system in GitHub Actions.

If you'd like to request this feature, consider submitting a feature request to the Dataform issue tracker on GitHub. Please note that I cannot provide a timeline for implementation. You can monitor the issue tracker for updates. Check the Dataform release notes for the most recent developments.

I hope the above information is helpful.

[knight_m]

Hello @NorieRam ,

Thanks for the reply, for some context. We have our Devops in Azure and the architure/solutions in GCP.

I hope there will be feature that will be added to the Workflow configuration where the workflow will trigger once a commit is merged into a specified branch.  Considering to submit a feature request as suggested.
Thanks.