LibraryProgress

Generated Files

llm-course/home

Topics

MDComputer & Python Foundations7 filesMDMathematics11 filesMDMachine Learning8 filesMDNeural Networks12 filesMDNLP7 filesMDTokenization12 filesMDEmbeddings7 filesMDPositional Information6 filesMDAttention12 filesMDMulti-Head Attention6 filesMDTransformer10 filesMDLanguage Modeling6 filesMDText Generation7 filesMDStopping Generation6 filesMDLLM Architecture9 filesMDContext Window6 filesMDLLM Training15 filesMDBuild a Small LLM10 filesMDModel Precision5 filesMDQuantization14 filesMDGPU & Memory7 filesMDKV Cache5 filesMDFine-Tuning6 filesMDLoRA7 filesMDAlignment6 filesMDRAG12 filesMDVector Search10 filesMDFunction Calling7 filesMDAgents8 filesMDInference9 filesMDInference Optimization4 filesMDDistributed Training7 filesMDMixture of Experts6 filesMDMultimodal LLMs7 filesMDReasoning Models6 filesMDEvaluation10 filesMDLLM Systems9 filesMDLLM Research10 files

Course progress

0%

0% of 38 sections

LLM Learning Hub

workspace/llm-course/home

← RAG

Chunk Overlap

Chunk overlap is the number of characters or tokens shared between adjacent chunks, ensuring that semantically related content split across a boundary is not lost during retrieval.

What is Chunk Overlap?

Chunk overlap is the number of characters or tokens shared between adjacent chunks, ensuring that semantically related content split across a boundary is not lost during retrieval.

Chunk overlap is the number of characters or tokens shared between adjacent chunks, ensuring that semantically related content split across a boundary is not lost during retrieval.

Where is it used?

LangChain's default overlap is 10-20% of chunk size; LlamaIndex and Haystack set overlap to preserve context around split points; too much overlap wastes storage, too little loses context.

How to build it

Use `RecursiveCharacterTextSplitter(chunk_size=500, chunk_overlap=100)` and verify chunks 0 and 1 share the last 100 chars of chunk 0; sweep overlap 0-200 and measure retrieval recall.

Back to RAG