Thompson Sampling
Thompson sampling draws a plausible success rate for each arm from its posterior and plays the largest draw. Uncertain arms get tried in proportion to how likely they are to be best.
-
-
Bandit Algorithms
A bandit algorithm chooses among options while it learns which is best. Regret measures what the learning cost compared with always choosing the best option.