Working with Tabular Data at Scale
Unglamorous techniques, each worth a large constant factor.
-
-
Single-Node Analytics: DuckDB, Polars, and Arrow
Compare DuckDB, Polars, and Arrow with Parquet queries, null-safe joins, and interchange checks. Separate result correctness from memory and speed claims.
-
Parquet
Understand Parquet row groups, column chunks, and optional statistics, and separate a file format from table transactions.
-
Data Formats: Parquet, ORC, Avro, and Arrow
Learn what each format stores, how readers skip data, and which schema and layout choices change analytical work.
-
How Computers Store Data
Before any pipeline runs, one agreement has to hold: what do these bytes mean?