LibraryProgress

Generated Files

llm-course/home

Topics

MDComputer & Python Foundations7 filesMDMathematics11 filesMDMachine Learning8 filesMDNeural Networks12 filesMDNLP7 filesMDTokenization12 filesMDEmbeddings7 filesMDPositional Information6 filesMDAttention12 filesMDMulti-Head Attention6 filesMDTransformer10 filesMDLanguage Modeling6 filesMDText Generation7 filesMDStopping Generation6 filesMDLLM Architecture9 filesMDContext Window6 filesMDLLM Training15 filesMDBuild a Small LLM10 filesMDModel Precision5 filesMDQuantization14 filesMDGPU & Memory7 filesMDKV Cache5 filesMDFine-Tuning6 filesMDLoRA7 filesMDAlignment6 filesMDRAG12 filesMDVector Search10 filesMDFunction Calling7 filesMDAgents8 filesMDInference9 filesMDInference Optimization4 filesMDDistributed Training7 filesMDMixture of Experts6 filesMDMultimodal LLMs7 filesMDReasoning Models6 filesMDEvaluation10 filesMDLLM Systems9 filesMDLLM Research10 files

Course progress

0%

0% of 38 sections

LLM Learning Hub

workspace/llm-course/home

MDSection 19 of 38 · 5 subtopics

Model Precision

FP32, FP16, BF16. How numerical precision affects speed, memory, and accuracy.

Learning path

Work through each subtopic in order. Click any file below to open its lesson. Track your progress with the checkbox at the bottom.

Subtopics

Each subtopic includes a concise explanation, code examples, and references.

01

Floating-Point Numbers

Bit-level representation.

floating-point-numbers
02

FP32

32-bit representation.

fp32
03

FP16

16-bit comparison.

fp16
04

BF16

BF16 vs FP16 vs FP32 comparison.

bf16
05

Mixed Precision

Layer precision map.

mixed-precision
Build aQuantization