3 years ago

Category: Database, Data, Docker

One defines workflows that are used to trigger individual pieces of code you want to run on your machine/system.

You’d define several tasks you want to be executed in a simple Python script and assign them to a DAG — Directed Acyclic Graph.

Let’s look at an example Operator: Use the bitshift operator in Python to specify workflows in Airflow.

Here is an example for the latter: Sensors can run multiple times in a DAG and are based on the BashSensorOperator

Here are two simple examples of how you can use Jinja in Airflow: In Airflow we get some pre-configured things to work within our templates.