Cross-Validation (CV)
On one dataset, five-fold CV ranges from 0.47 to 0.62 across split seeds. A separate ten-fold simulation illustrates why naive fold error bars can be too small.
-
-
Machine Learning (ML)
One model scored a perfect 1.0000 on the rows it was trained on and 0.3474 on new ones. Another scored 0.9842 and 0.9822.
-
Empirical Risk Minimization and Generalization
Training minimizes error on a sample. Everything hard is the gap to the population.