3 years ago

Category: Database, Docker, Infrastructure, Jenkins, encryption, github, yaml

I created a repo to deploy Airflow on AWS following software engineering best practices. Run a docker-compose command and voíla, you have Airflow running on your local environment, and you are ready to develop some DAGs. After some time you have your DAGs (and Airflow) prepared for deployment on a production environment.

Just clone the repo, follow the few instructions and install the requirements described on the README file and then run: This will deploy an Airflow instance to your AWS account!

With this deployment of Airflow, you will submit changes to your DAGs, and it won’t try to redeploy the infrastructure for you.