Technical requirements

This chapter requires that Airflow is installed on your local machine. You can install it directly on your Operating System (OS) or using a Docker image. For more information, refer to Chapter 1, and the Configuring Docker for Airflow recipe.

After following the steps described in Chapter 1, ensure Airflow runs correctly. You can do that by checking the Airflow UI at this link: http://localhost:8080

If you are using a Docker container (as I am) to host your Airflow application, you can check its status in the terminal by using the following command:

$ docker ps

Here is the status of the container:

Figure 12.1 – Airflow containers running

Figure 12.2 – Docker Desktop view of Airflow containers running

Docker images

This chapter requires the creation of other Docker containers to build the monitoring and observability architecture. If you are using docker-compose.yaml file to...