Alignment
One word, taught differently in 3 fields. Each use is given apart.
In AI & ML
The process of adjusting a pre-trained language model to align with human preferences.
In Bio & Neuro
An expensive dynamic programming algorithm used for determining the exact similarity and mismatch locations between two strings.
In Systems & CS
Alignment determines how subviews of unequal dimensions are aligned along the cross axis within a stack, using directional guides like leading instead of left.
Know first
Named as a prerequisite by the lectures that define this. The number is how many say so. A grey one has no page yet.
Approximate string matching1Assistant models1Contrastive loss1Embedding1Feature space1Fine-tuning1HStack1Language model1
Opens up
Concepts that name this one as a prerequisite.
In AI & ML
5Each in their own terms, from the easiest level.
Andrej Karpathy
The process during fine-tuning of changing the formatting from internet documents to question-and-answer assistant responses.Sara Beery
A property of good representations where data from the same class or positive pairs are pulled close together.Nathan Lambert
General notion of training a model to mirror user desires, any loss function.Rongzhe Wei
Techniques used to ensure that large language models adhere to safety guidelines and behave in a helpful and harmless manner.
In Bio & Neuro
1In Systems & CS
1Lectures that assume it
1Connections
14The lectures that define it or assume it, and the concepts next to it.
Concepts6
Lectures8
- Introduction to Large Language Models
- Reactive UI, Protocols, and Layout in SwiftUI
- Representation Learning: Similarity-Based
- Atomic Facts to Structured Knowledge: Rethinking Unlearning & Jailbreaking in Large Language Models
- From Large Language Models to Large Multimodal Models
- GRIM-Filter: In-Memory Seed Location Filtering in 3D-Stacked DRAM