Narrow and Wide Dependencies
Some operations keep each partition’s work local; others need rows from everywhere. That difference is where stage boundaries and expensive recovery come from.
Some operations keep each partition’s work local; others need rows from everywhere. That difference is where stage boundaries and expensive recovery come from.