Top-k and Top-p Sampling
Top-k and top-p (nucleus) sampling are two ways of cutting off the unlikely tail of a language model’s next-token distribution before choosing a token at random.
Top-k and top-p (nucleus) sampling are two ways of cutting off the unlikely tail of a language model’s next-token distribution before choosing a token at random.