Executors
Executors determine how task instances are going to be executed in an Airflow environment. They are pluggable, allowing teams to swap different executors based on their business goals and needs. Each Airflow environment can only have one executor configured at a time which can be adjusted within the configuration file.
You may see the executors displayed as SequentialExecutor
in the official documentation and in the configuration files. In this chapter we will keep the words separated for ease of documentation and refer to them by their type such as Sequential instead of SequentialExecutor
.
As of the time of writing there are multiple types of executors, and the community continues to expand on options. Table 4.1 contains a list of executors currently available, as well as ones that have been deprecated. In the following table, we will cover additional details around the most common executors and best use cases.