LLMs (Large Language Models)
Many generative LLMs predict text one token at a time. Their training enables useful language tasks, while generated answers still need checks against the task and available evidence.
-
-
Language Model Objectives and Limits
A language model learns the conditional distribution of the next token. That one objective explains both its range and why its answers are not reliably correct.