ConceptAI & ML
Supervised finetuning
Training a pre-trained model on a smaller, supervised dataset to adapt it for a specific downstream task.
Know first
Named as a prerequisite by the lectures that define this. The number is how many say so. A grey one has no page yet.
Finetuning1Language model pretraining1Model parameters1Neural networks1Pre-training1Supervised learning1
Lecturers
3Each in their own terms, from the easiest level.
Ming Ding
An ordinary fine-tuning process for language models using high-quality datasets, often annotated by human experts.Negar Mehr
SFT overwrites the parameters important to each task and forgets the previous task.
Connections
5The lectures that define it or assume it, and the concepts next to it.