Worksheets
In-class worksheets, posted here after the class that uses them. Answers go up once the class has discussed them.
| Week |
Topic |
Worksheet |
Answers |
| Week 3 |
The Transformer: attention, masking, KV cache, architectures |
PDF |
PDF |
| Week 4 |
Pretraining, scaling laws, fine-tuning, and the same ideas in code |
PDF |
PDF |
| Week 5 |
RLHF, reasoning models, test-time scaling, Codex and pass@k |
PDF |
PDF |
| Week 7 |
RAG, Elasticsearch 101, RAG failure points, agents, ReAct, MCP, Reflexion |
PDF |
after discussion |
Exam review
| Sheet |
What it covers |
PDF |
| Midterm 1 review sheet |
Fri, Oct 9 · scope, format, checklist, practice problems with answers |
PDF |
Past exams
| Exam |
Questions |
Solutions |
| Midterm 1 |
PDF |
PDF |