How LLMs Work
Beginner1 hr
A grounded walkthrough of how an LLM is built: pre-training on huge text corpora, supervised fine-tuning, and reinforcement learning from human feedback (RLHF).
Pre-trainingFine-tuningRLHFNext-token prediction
Learn from these
Intro to Large Language Models
Andrej Karpathy · 1 hr
Deep Dive into LLMs like ChatGPT (optional, long-form)
Andrej Karpathy · 3.5 hr
How do LLMs work? (LLM course, chapter 1)
CourseHugging Face