Optimization for Machine Learning
Fitting a model means minimizing something. The objective’s geometry decides everything else.
Fitting a model means minimizing something. The objective’s geometry decides everything else.
Machine learning borrows its estimators from statistics and too often leaves the uncertainty behind.
Training a network is following a slope downhill. This is the calculus that defines the slope.
Most modeling mistakes are probability mistakes wearing a modeling costume.
If you have looked at a spreadsheet, you have looked at the central object of machine learning. Everything else is built on that.
Every code block in this series is NumPy or PyTorch. This is the array vocabulary they both assume.
A function fitted to a sample fits that sample better than it fits anything else. Everything difficult follows from that.