Spark Shuffle
Understand how Spark regroups records across partitions, why partial aggregation helps, and why an exchange alone does not measure network bytes.
Understand how Spark regroups records across partitions, why partial aggregation helps, and why an exchange alone does not measure network bytes.