LibraryProgress

Generated Files

llm-course/home

Topics

MDComputer & Python Foundations7 filesMDMathematics11 filesMDMachine Learning8 filesMDNeural Networks12 filesMDNLP7 filesMDTokenization12 filesMDEmbeddings7 filesMDPositional Information6 filesMDAttention12 filesMDMulti-Head Attention6 filesMDTransformer10 filesMDLanguage Modeling6 filesMDText Generation7 filesMDStopping Generation6 filesMDLLM Architecture9 filesMDContext Window6 filesMDLLM Training15 filesMDBuild a Small LLM10 filesMDModel Precision5 filesMDQuantization14 filesMDGPU & Memory7 filesMDKV Cache5 filesMDFine-Tuning6 filesMDLoRA7 filesMDAlignment6 filesMDRAG12 filesMDVector Search10 filesMDFunction Calling7 filesMDAgents8 filesMDInference9 filesMDInference Optimization4 filesMDDistributed Training7 filesMDMixture of Experts6 filesMDMultimodal LLMs7 filesMDReasoning Models6 filesMDEvaluation10 filesMDLLM Systems9 filesMDLLM Research10 files

Course progress

0%

0% of 38 sections

LLM Learning Hub

workspace/llm-course/home

MDSection 31 of 38 · 4 subtopics

Inference Optimization

Faster inference: Flash Attention, speculative decoding, memory and compute trade-offs.

Learning path

Work through each subtopic in order. Click any file below to open its lesson. Track your progress with the checkbox at the bottom.

Subtopics

Each subtopic includes a concise explanation, code examples, and references.

01

Flash Attention

Attention-memory comparison.

flash-attention
02

Speculative Decoding

Draft-model → verification-model animation.

speculative-decoding
03

Memory Optimization

VRAM allocation dashboard.

memory-optimization
04

Compute Optimization

FLOPs/throughput dashboard.

compute-optimization
InferenceDistributed Training