Model Compression and Deployment
The model is the easy part. Everything after training is where deployments fail.
The model is the easy part. Everything after training is where deployments fail.
A change too small to see can flip a classifier’s answer. That is a property of the models, not a bug in one of them.
A softmax output of 0.99 is not a 99% chance of being right. Here is how far apart those two things are.
A model that is right for the wrong reason will fail the moment the reason changes.