Lecture Logistics
Lectures will be held in-person at 1-190 (campus map).
Lecture notes
2024 Course Schedule (tentative)
| Event | Course Date | Lecture | Reading | Logistic |
|---|---|---|---|---|
| Lecture 1 | Feb. 06 | Introduction slides | ||
| Lecture 2 | Feb. 08 | Simple Decision Making slides | Bandits: Chapter 6, 7, 8, 9; Contextual Bandits: Chapter 18, 19; LinUCB: paper. | |
| Lecture 3 | Feb. 13 | Simple Decision Making (from page 29) video | HW1 Released | |
| Lecture 4 | Feb. 15 | Policy Gradient slides | ||
| Holiday | Feb. 20 | (No class) | ||
| Lecture 5 | Feb. 22 | Policy Gradient (from page 17) | Horizon: paper | HW2 Released |
| Lecture 6 | Feb. 27 | Policy Graident (from page 82) | ||
| Lexture 7 | Feb. 29 | Policy Gradient (from page 112) | HW3 Released (Friday) | |
| Lecture 8 | Mar. 05 | Policy Gradient (from page 127) Reward Design & Shaping slides | ||
| Lecture 9 | Mar. 07 | Learning from Demonstration slides | HW4 Released (Friday) | |
| Lecture 10 | Mar. 12 | Learning from Demonstration (from page 33) | ||
| Lecture 11 | Mar. 14 | Learning from Demonstration (from page 52) Transfer from Simulation to Real World slides | HW5 Released (Friday) | |
| Lecture 12 | Mar. 19 | Transfer from Simulation to Real World (from page 32) | ||
| Lecture 13 | Mar. 21 | Transfer from Simulation to Real World (from page 124) Model Learning slides | Project Proposal Due, HW6 Released (Friday) | |
| Holiday | Mar. 26 | Spring break (No class) | ||
| Holiday | Mar. 28 | Spring break (No class) | ||
| Lecture 14 | Apr. 02 | Model Learning (from page 43) | ||
| Lecture 15 | Apr. 04 | Model Learning (from page 69) Tabular RL slides | HW7 Released (Friday) | |
| Lecture 16 | Apr. 09 | Tabular RL (from page 24) | ||
| Lecture 17 | Apr. 11 | Deep Q Learning slides | HW8 Released (Friday) | |
| Lecture 18 | Apr. 16 | Deep Q Learning (from page 48) | ||
| Lecture 19 | Apr. 18 | Special lecture slides | ||
| Lecture 20 | Apr. 23 | Goal and Multi-Task Learning (cont'd) [video] | ||
| Lecture 21 | Apr. 25 | Hierarchical RL [video] | Project Midterm Report Due (Friday) | |
| Lecture 22 | Apr. 30 | Curriculum Learning [slides] | ||
| Lecture 23 | May 02 | Exploration in RL [slides] | ||
| Lecture 24 | May 07 | Wrapping Up [reading] | ||
| Lecture 25 | May 09 | Project Presentations | [video] | |
| Lecture 26 | May 14 | Project Presentations |