Large Language Models for Code and Proof
Joint course for MVA Master Vision Apprentissage and IASD Intelligence Artificielle et Science des Données, Paris
Presentation
Useful links:
Schedule
- 6 Jan: Transformers 101 (NF)
- Slides for Transformers 101
- Assignment: the Lipogram Challenge. Instructions (and solutions) and submission space
- Recordings (2 parts) (password: zL$i26.7)
- 13 Jan: Lecture cancelled
- Slides for "A dive into AI Coding Agents"
- Assignment: Play Chess like a Honey Bee. Instructions and submission space
- 20 Jan: Mechanistic Interpretability (David Louapre's guest lecture), Tool calling & Agents (NF)
- Slides for Mechanistic Interpretability
- Slides for Tool Calling & Agents
- Recordings (2 parts) (password: 41..mn9q)
- Assignment: Playing Zork has never been so boring. Submission space
- 27 Jan: Advanced Architecture & Semantic Search (NF)
- Slides for Advanced Architecture
- Slides for Tokenizers (skipped, treat as self-study)
- Slides for Semantic Search
- Recordings (2 parts) (password: MDPJ&z9E)
- 3 Feb: FlashAttention (Marc Lelarge)
- 10 Feb: TBA (Marc Lelarge)
- 17 Feb: TBA (Marc Lelarge)
- 10 March: TBA (Nathanaël Fijalkow?)
- 17 March: TBA (Marc Lelarge)
Teachers