MDSection 12 of 38 · 6 subtopics
Language Modeling
Predicting the next token. Logits, probability distributions, and the causal LM objective.
Learning path
Work through each subtopic in order. Click any file below to open its lesson. Track your progress with the checkbox at the bottom.
Subtopics
Each subtopic includes a concise explanation, code examples, and references.
01
Language Model
Next-token prediction interface.
language-model
02
Next-Token Prediction
Probability-bar visualization.
next-token-prediction
03
Autoregressive Generation
Token-by-token timeline.
autoregressive-generation
04
Logits
Raw-score bar chart.
logits
05
Probability Distribution
Probability bars.
probability-distribution
06
Causal Language Modeling
Input/target alignment.
causal-language-modeling