Regression and Ranking Metrics
A metric is a choice about which errors you will tolerate.
A metric is a choice about which errors you will tolerate.
Ranking, probability, and decision are three separate things to evaluate.
Unglamorous techniques, each worth a large constant factor.
Both are called art. Both have measurable effects.
Most of a project’s decisions are made here, and almost none are recorded.
Leakage compromises evaluation when unavailable information enters fitting or selection; it need not raise every observed score.