DevOps Articles

Curated articles, resources, tips and trends from the DevOps World.

Apache Airflow Primer

4 years ago fschulz.medium.com
Apache Airflow Primer

Summary: This is a summary of an article originally published by the source. Read the full original article here →

One defines workflows that are used to trigger individual pieces of code you want to run on your machine/system.

You’d define several tasks you want to be executed in a simple Python script and assign them to a DAG — Directed Acyclic Graph.

Let’s look at an example Operator: Use the bitshift operator in Python to specify workflows in Airflow.

Here is an example for the latter: Sensors can run multiple times in a DAG and are based on the BashSensorOperator

Here are two simple examples of how you can use Jinja in Airflow: In Airflow we get some pre-configured things to work within our templates.

Made with pure grit © 2024 Jetpack Labs Inc. All rights reserved. www.jetpacklabs.com