Technical approaches for migration
In this section, we will discuss a series of technical solutions to help alleviate commonly encountered activities as part of a migration. Not all of these solutions will apply to every scenario, but they’re worth considering and deciding on as part of planning your migration.
Automating code migrations
If you have a large number of workflows to migrate, automating the generation of your Airflow DAGs from source artifacts will be a natural point of discussion and decision to be made.
When deciding to undertake automation, it is natural to try and make your tooling as perfect as possible in taking source code to a new destination – don’t try for perfection. Remember that you’re only going to do this migration “once,” so you should just be shooting for “good enough” to get you most of the way, and accept that a certain number of manual steps will be required to clean up and finalize any...
