This website uses Cookies. Click Accept to agree to our website's cookie use as described in our Privacy Policy. Click Preferences to customize your cookie settings.
Accept
Reject
Preferences
Log in to ask a question
Get hands-on experience with 20+ free Google Cloud products and $300 in free credit for new customers.
Log in to ask a question

Unknown problem with connection to Airflow Database, server closed connection unexpectedly.

Posted on 10-04-2023 07:50 PM
Chanan
Bronze 2
Bronze 2
Reply posted on --/--/---- --:-- AM

I have daily ingest pipeline as production runs on Cloud Composer, the code is unchanged for a while. One day there is one error that raised from database_health.py which is

Chanan_0-1696473738203.png

after that, in Log Explorer their are following errors from "airflow-scheduler" and "airflow-worker" that have the same errors text as above like "server closed connection unexpectedly"

Chanan_1-1696474101228.png

and i think it happen between "PSC endpoint" and "airflow database " on tenant project


Chanan_0-1696476952000.png

I want to know how to deal with this issue, it maybe happen occasionally but the customer are really concern with this problem.


Sincerely, Chanan

 

0 1 1,244
Topic Labels
0 Likes
1 REPLY 1