DAGs
DAGs are the primary way to orchestrate data pipelines. They are built from Python and use a wide variety of supporting libraries. Following the previous steps to initialize a local development environment has loaded example_dag_basic, which we will review in this section.
Fundamentally, DAGs are comprised of tasks, operators, and sensors. There are new techniques that have been introduced over the years, relating to task groups and deferrable operators, that we will also cover in this chapter.
To access a visualization of this DAG, simply select the DAG name on the web server console. You will initially be prompted with specific information about the DAG configuration and the status of its previous runs.
Figure 2.7: Configuring the DAG
To view a visualized representation of this initial DAG example, select the Graph option from the list of options at the top of the DAG area. This will bring up a graphical representation of the DAG example....
