LLM Decoding and Structured Output
A language model outputs a distribution, and the decoder picks the tokens. Learn temperature and top-p, token masking for structured output, and how to evaluate it.
A language model outputs a distribution, and the decoder picks the tokens. Learn temperature and top-p, token masking for structured output, and how to evaluate it.