https://blog-8of.pages.dev/A personal blog on data engineering, software, and the craft of building things. 2026-04-13T12:24:10-04:00 Yegor Bryzhan https://blog-8of.pages.dev/ Jekyll © 2026 Yegor Bryzhan /assets/img/favicons/favicon.ico /assets/img/favicons/favicon-96x96.png 2026-04-12T13:31:00-04:00 2026-04-12T13:31:00-04:00 https://blog-8of.pages.dev/posts/airflow-on-aws-01/ Yegor Bryzhan

An orchestrator is a vital component of any modern data engineering stack. It allows you to define, schedule, and monitor complex data pipelines as code, ensuring tasks run in the right order and failures are handled gracefully. There are quite a few choices when it comes to orchestrators, but the most popular ones are Apache Airflow, Prefect, and Dagster, with Apache Airflow being the most wid...