Fine-Tuning and Alignment
A pretrained model continues text. Three further stages turn that into something that follows instructions.
-
-
Instruction Tuning
Understand instruction tuning as training on task instructions and responses, and distinguish it from prompting and retrieval.