MDSection 34 of 38 · 7 subtopics
Multimodal LLMs
Beyond text: images, audio, video. Vision encoders, cross-modal alignment.
Learning path
Work through each subtopic in order. Click any file below to open its lesson. Track your progress with the checkbox at the bottom.
Subtopics
Each subtopic includes a concise explanation, code examples, and references.
01
Multimodal Models
Text/image/audio input workspace.
multimodal-models
02
Vision-Language Models
Image + text alignment view.
vision-language-models
03
Image Embeddings
Image-to-vector pipeline.
image-embeddings
04
Vision Encoder
Image patch visualization.
vision-encoder
05
Audio Models
Waveform → representation visualization.
audio-models
06
Video Understanding
Frame timeline.
video-understanding
07
Cross-Modal Representation
Shared embedding space.
cross-modal-representation