16 engineers on Hacker News describe using Apache Airflow first-hand: 4 endorse it, 2 regret it, 0 are mixed.
“the net result is we now have a working model to easily perform on-prem to cloud data migrations.”
endorse · production · rtp4me · 2025-07-18 · source ↗ · wrong label?“Once Airflow has an (planned or unplanned) outage, 10s of thousands of job start piling up, and it never recovers from that.”
regret · production · geertj · 2022-08-02 · source ↗ · wrong label?“We use Airflow to orchestrate ML jobs/tasks, and I found it to be more flexible comparing other tools we tested.”
endorse · production · smurf_t · 2020-12-21 · source ↗ · wrong label?“I've been using Airflow for the past 6 months extensively in my projects and it is such a pleasure to use.”
endorse · personal · 0.5 yr · arthurcolle · 2020-12-17 · source ↗ · wrong label?“Me and my team tried Airflow but found it didn't fit well with our analytics work flow.”
regret · personal · kfk · 2019-12-26 · source ↗ · wrong label?“We've been using it for our ETL and it's been working greatly so far.”
endorse · production · garthz · 2015-06-23 · source ↗ · wrong label?“We migrated 300+ jobs from a different but roughly similar orchestration tool to Airflow DAGs”
neutral · production · gregw2 · 2024-07-29 · source ↗ · wrong label?“I've been using airflow and astronomer-cosmos which is not perfect but I didn't enjoy using dagster last time I tried.”
neutral · production · adammarples · 2023-12-14 · source ↗ · wrong label?“embeddings get created through platforms like Airflow, metadata in a document store”
neutral · production · ramoz · 2023-07-19 · source ↗ · wrong label?“I manage like 40 APIs in our airflow”
neutral · production · shmoogy · 2022-12-16 · source ↗ · wrong label?“We run Airflow at a pretty massive scale and not all of these boundaries were enforced so now it's a huge mess.”
neutral · production · llbeansandrice · 2022-08-02 · source ↗ · wrong label?“There are very few organizations offering support for Airflow and they aren't cheap.”
neutral · production · dataminded · 2020-11-25 · source ↗ · wrong label?“We run 1 t3.xlarge instances 4vCPU for the scheduler and web server and 1 t3.xlarge instance (4vCPU) for the workers.”
neutral · production · mchusma · 2020-11-24 · source ↗ · wrong label?“we still have some legacy on airflow, but all new data engineering dev is in pachyderm”
neutral · production · ryan_j_naughton · 2020-09-03 · source ↗ · wrong label?“This is all automated with python scripts and airflow.”
neutral · production · mattbillenstein · 2017-10-04 · source ↗ · wrong label?“We wrote a custom Airflow operator which launches a cluster, schedules a job on that cluster, and shuts down the cluster”
neutral · production · natekupp · 2017-06-06 · source ↗ · wrong label?