Thompson Sampling
Thompson sampling draws a plausible success rate for each arm from its posterior and plays the largest draw. Uncertain arms get tried in proportion to how likely they are to be best.
-
-
Bandits and Exploration
A bandit earns more reward and gives you a worse estimate of the effect.