Analytical Engines and Storage Layout
Two engines run the same SQL and one finishes far sooner. See which layer supplies which part of that gap, and where each one stops helping.
-
-
BigQuery Architecture and Cost
BigQuery bills what a query reads or the slots it occupies. Work through column, partition, and clustering effects, dry runs, slot time, and the on-demand versus capacity choice.
-
Partitioning, Compaction, and Table Maintenance
Lakehouse tables degrade through small files, drifting layouts, and old snapshots. See how sizing, pruning, compaction, and expiry work and how to validate their cost.
-
Spark Partitioning, Shuffles, and Data Skew
Understand partition distributions, salted aggregates and joins, broadcast plans, coalesce, and Parquet file counts while preserving query semantics.
-
Designing an Object-Storage Data Lake
Build a data lake with discoverable datasets, immutable runs, conditional publication, safe cleanup, and layouts matched to queries.