Lecture Logistics
Lectures will be held in-person at 1-190 (campus map).
Lecture notes
Download link (updated to Lecture 15)
2022 Course Schedule (tentative)
| Event | Course Date | Lecture | Reading | Logistic |
|---|---|---|---|---|
| Lecture 1 | Feb. 01 | Introduction slides, video | ||
| Lecture 2 | Feb. 03 | Simple Decision Making slides, video | Bandits: Chapter 6, 7, 8, 9; Contextual Bandits: Chapter 18, 19; LinUCB: paper. | HW1 Released |
| Lecture 3 | Feb. 08 | On-policy Learning slides, video | ||
| Lecture 4 | Feb. 10 | Variance Reduction in On-Policy Learning slides, video | ||
| Lecture 5 | Feb. 15 | Advanced Policy Gradients slides, video | HW2 Released | |
| Lecture 6 | Feb. 17 | Reward Design & Shaping slides, video | ||
| Holiday | Feb. 22 | HW3 Released (No class) | ||
| Lecture 7 | Feb. 24 | Learning from Demonstration slides, video | ||
| Lecture 8 | Mar. 01 | Learning from Demonstration (cont'd) slides, video | HW4 Released | |
| Lecture 9 | Mar. 03 | Inverse Reinforcement Learning slides, video | ||
| Lecture 10 | Mar. 08 | Transfer from Simulation to Real World slides 1, slides 2, video | HW5 Released | |
| Lecture 11 | Mar. 10 | Transfer from Simulation to Real World (cont'd) slides, video | Project Proposal Due | |
| Lecture 12 | Mar. 15 | Model-Based Reinforcement Learning slides, video | HW6 Released | |
| Lecture 13 | Mar. 17 | Inverse Models slides, video | ||
| Holiday | Mar. 22 | Spring break (No class) | ||
| Holiday | Mar. 24 | Spring break (No class) | ||
| Lecture 14 | Mar. 29 | Solving Sequential Decision Making in Tabular Setups slides, video | HW7 Released | |
| Lecture 15 | Mar. 31 | Deep Q Learning slides, video | ||
| Lecture 16 | Apr. 05 | Offline RL slides, video | HW8 Released, Project Midterm Report Due | |
| Lecture 17 | Apr. 07 | Goal Conditioned RL slides, video | ||
| Lecture 18 | Apr. 12 | Curriculum Learning slides 1, slides 2, video | ||
| Lecture 19 | Apr. 14 | Exploration and Self-Play slides, video | ||
| Lecture 20 | Apr. 19 | Misc Topics (Safety, Multi-Agent) slides, video | ||
| Lecture 21 | Apr. 21 | Guest Lecture - Healthcare video | ||
| Lecture 22 | Apr. 26 | Case Studies slides, video | ||
| Lecture 23 | Apr. 28 | Guest Lecture - Robot Learning video | ||
| Lecture 24 | May 03 | Task Specification Problem slides, reading, video | ||
| Lecture 25 | May 05 | Project Presentations | ||
| Lecture 26 | May 10 | Project Presentations |