MDSection 13 of 38 · 7 subtopics
Text Generation
Generating text: temperature, top-k, top-p, repetition penalty, beam search. The generation toolbox.
Learning path
Work through each subtopic in order. Click any file below to open its lesson. Track your progress with the checkbox at the bottom.
Subtopics
Each subtopic includes a concise explanation, code examples, and references.
01
Greedy Decoding
Highest-probability token selector.
greedy-decoding
02
Random Sampling
Probability-wheel sampler.
random-sampling
03
Temperature
Distribution slider.
temperature
04
Top-K
Ranked-token filter.
top-k
05
Top-P
Cumulative-probability selector.
top-p
06
Repetition Penalty
Token-probability comparison.
repetition-penalty
07
Beam Search
Search tree.
beam-search