Dynamic Allocation
Adjust Spark executor allocation with demand, preserve shuffle access, and separate executor release from immediate capacity or lower resource charges.
-
-
Spark Event Log
Retain Spark execution events for later diagnosis, configure shared history access, and distinguish event evidence from application logs and recovery data.
-
Optimizing Spark Jobs in Production
Diagnose production Spark work, preserve query results, compare repeated runs, and decide whether a faster job also meets cost and delivery requirements.