Deep Ensembles
Deep ensembles average separately trained networks. Error correlation limits gains, and member disagreement captures only part of predictive uncertainty.
-
-
Uncertainty Estimation and Model Calibration
A softmax output of 0.99 is not a 99% chance of being right. Here is how far apart those two things are.