Large Language Models for Code and Proof
Joint course for MVA Master Vision Apprentissage and IASD Intelligence Artificielle et Science des Données, Paris
Presentation
Useful links:
Schedule
- 6 Jan: Transformers 101 (NF)
- Slides for Transformers 101
- Assignment: the Lipogram Challenge. Instructions, submission space, and solutions
- Recordings (2 parts) (password: zL$i26.7)
- 13 Jan: Lecture cancelled
- Slides for "A dive into AI Coding Agents"
- Assignment: Play Chess like a Honey Bee. Instructions and submission space
- 20 Jan: Mechanistic Interpretability (David Louapre's guest lecture), Tool calling & Agents (NF)
- Slides for Mechanistic Interpretability
- Slides for Tool Calling & Agents
- Recordings (2 parts) (password: 41..mn9q)
- Assignment: Playing Zork has never been so boring. Instructions and submission space
- 27 Jan: Advanced Architecture & Semantic Search (NF)
- 3 Feb: FlashAttention (Marc Lelarge)
- 10 Feb: TBA (Marc Lelarge)
- 17 Feb: Controller generation (Marc Lelarge)
- 3 March: KV-Cache and LoRA (Marc Lelarge)
- 10 March: Pre- and post-training (NF)
- Slides for Pre-training
- Slides for Post-training
- Slides for Grammar alignment
- Recordings (2 parts) (password: 59Y&pdDu)
- 24 March: Exam
Teachers