Local testing for cloud composer

[Kittylon]

Hello,

Currently, we use cloud composer to use apache airflow (1.10.14+composer).
Before we deploy our code, we want to test it locally, what's the best way to replicate cloud composer in a local environment?

We already use a docker-compose set up with the image apache/airflow:1.10.14, but it doesn't behave as it does in cloud composer.

Any tips are appreciated! 🙌🏻

[oakinlaja]

Hello,

I see you posted a similar question on Stackoverflow and a suggestion provided[0]. I hope that info was helpful. 

I found this article[1] as well, which I believe addresses this use-case.

[0]https://stackoverflow.com/questions/70037224/local-testing-for-cloud-composer

[1]https://medium.com/@jbencina/local-testing-with-google-cloud-composer-apache-airflow-75d4213d2893 

[Kittylon]

Hi Oakinlaja,

Thanks, I went for option 2 🙂

[rsenseman]

Any updates here on pulling an image consistent with the Cloud Composer Airflow environment?