Compute budgets
A compute budget constrains resources, spending, and experiment choices. Account for elapsed time, memory, overhead, and the value of further evidence.
A compute budget constrains resources, spending, and experiment choices. Account for elapsed time, memory, overhead, and the value of further evidence.
Successive halving spends little on all candidates and more on survivors. The allocation can save evaluation work, but small early samples and adaptive selection still affect the result.