Get hands-on experience with 20+ free Google Cloud products and $300 in free credit for new customers.

Emmanuel Katto : How to Prevent a DAG from Running Automatically on Startup in Airflow?

Hello everyone,
I'm Emmanuel Katto, We’re using Airflow in a daily pipeline, and everything runs in the morning. After the jobs complete, we take a snapshot of the Composer environment and shut it down using GitLab pipelines. The next morning, we restore the environment and load the latest snapshot.
The issue we’re facing is that DAGs still run automatically even though they are disabled and catchup is set to False. For example, I had disabled a DAG I was testing a few days ago, but it still runs once a day when Airflow starts up, even though I don't expect it to.
Has anyone else encountered this issue? Could there be any other settings I’m missing that are causing the DAGs to start unexpectedly?

Regards

Emmanuel Katto

0 0 54
0 REPLIES 0