Apache Parquet

5 engineers on Hacker News describe using Apache Parquet first-hand: 1 endorse it, 0 regret it, 0 are mixed.

65%trust
5first-hand users
5in production
endorse 1mixed 0regret 0uses, no opinion

“we use Apache arrow and save as parquet files, which has lots of benefits over SQLite”

endorse · production · awill88 · 2021-12-08 · source ↗ · wrong label?

“labels are just columns in Parquet, so there is no per series index that grows with cardinality.”

neutral · production · nikhil4usinha · 2026-10-06 · source ↗ · wrong label?

“we use Apache Arrow for in-memory columnar processing and Apache Parquet for durable columnar storage”

neutral · production · yashdotrv · 2026-10-06 · source ↗ · wrong label?

“We're still using parquet. So we use the native duckdb format for intermediate processing (during pipeline execution)”

neutral · production · RobinL · 2024-12-16 · source ↗ · wrong label?

“We switched to it to Parquet on HDFS and did some (ok, a lot...)performance tuning and exactly the same processing ended up at 6 seconds.”

neutral · production · nl · 2020-09-21 · source ↗ · wrong label?