Language & LLMs

What Is Supervised Fine-Tuning?

Supervised fine-tuning further trains a pretrained language model on a curated dataset of example inputs and their correct outputs. It adapts the model toward a specific behavior, such as following instructions or answering in a certain style. It is often an early step before reinforcement learning from human feedback.