Generative AI Greedy Decoding and Beam Search ByJu Yeon Eum March 14, 2025October 12, 2026 A language model gives a probability distribution over the next token.