MDSection 5 of 38 · 7 subtopics
NLP
Text processing before Transformers: bag-of-words, TF-IDF, RNNs, LSTMs. The history that shows why attention won.
Learning path
Work through each subtopic in order. Click any file below to open its lesson. Track your progress with the checkbox at the bottom.
Subtopics
Each subtopic includes a concise explanation, code examples, and references.
01
Text Representation
Text transformation pipeline.
text-representation
02
One-Hot Encoding
Vocabulary matrix.
one-hot-encoding
03
Bag of Words
Document-term matrix.
bag-of-words
04
TF-IDF
Document-term heatmap.
tf-idf
05
RNN
Unrolled sequence diagram.
rnn
06
LSTM
Cell/gate visualization.
lstm
07
GRU
Simplified recurrent-cell visualization.
gru