Decision Threshold
The model produces a score. Someone decides which scores lead to a call, a block, or a review, and that someone is usually not the person who trained the model.
-
-
Binary Classification
One model, one set of probabilities. Moving the cut-off from 0.10 to 0.90 took precision from 0.5271 to 0.9864 and recall from 0.8869 to 0.4306.
-
Classification Metrics and Decision Thresholds
Ranking, probability, and decision are three separate things to evaluate.