Tasks
Tasks make up a DAG and move in order of completion, according to how they are defined. Tasks are often displayed in block formats to show how they will execute. In this basic example, there are three tasks to be completed in order. Tasks are also the most basic unit of execution in Airflow. A task represents a single operation or job that needs to be performed. Tasks are defined by operators in Airflow, with each operator determining the type of task performed. Common tasks include executing Python functions, running database queries, or performing data transformations.
Before we jump into analyzing this basic DAG example and the tasks associated with it, we need to explore operators and how they are used.
Task operators
In Apache Airflow, an operator represents a single, idempotent task that is part of a workflow defined by a DAG. Each operator in Airflow specifies a particular type of work to be done, encapsulating the logic to perform a specific task. Each operator...