Pause for Professional Development
I've paused my normal reading for a bit. I've had on my list to spend a lot more time with AirFlow. I've spent a lot of time professionally writing what can best be described as ETL, but I've never had any of the specific tooling. Airflow has seemed to be a great solution for my purposes, especially with the maturation of the DockerOperator, but in my current job, building pipelines has been relegated to just an as needed exercise rather than most of what I do.
So good or bad, I have several unrelated pipeline needs, so I thought now was a good a time to dive into AirFlow. The First step is generally the most frustrating, in that I start the process of developing a production environment.