4 years ago

Category: Deployment, Data, Kubernetes, Docker, automation

At Natural Intelligence we use Airflow extensively in order to create simple ETL flows as well as complex ML tasks that run on terabytes of data. However, with its great power, Airflow also presents great complexity and many pitfalls.