Summary
In this chapter, we covered some key areas of the Airflow architecture and the primary components that make up connections and secrets. We spent time analyzing what Connections are, how to create, edit, and delete a connection, and how they are best used. In addition, secrets are often needed to create and maintain connections. There are multiple ways and tools available to meet your team’s needs and business goals, but the following chart may help with future decisions.
|
Method |
Pros |
Cons |
|
Environment Variables |
Simple and easy to set up and use |
Not very secure, with no access from Airflow UI or CLI |
|
Metadata Database |
Quick to set up and edit values via the UI and CLI |
Not secure and hard to scale |
| ... |
