Get hands-on experience with 20+ free Google Cloud products and $300 in free credit for new customers.

Composer workers are restarting frequently

 @pgstorm148   I am using composer-2 [ composer-2.8.5-airflow-2.7.3 ] version in which i am running min= 2 scheduler, min= 2 worker and etc.

I have been observing on Composer GKE workloads that my both worker containers restarting continuously after sometime even no DAG or Task is running. I have just observed that it shows that liveness probe failed. 

Now i am not able to figure out why this is happening or how can i resolve it because we can not make any changes on GKE autopilot. I believe liveness failed is causing the container to restart which i believe check by airflow_monitoring dag created by itself [ correct me if i am wrong ].

Can anyone help me to understand and resolve this issue. Attaching screenshot.Screenshot 2025-03-19 at 9.15.13 PM.png

0 3 696
3 REPLIES 3