Lecture Logistics
Lectures will be held in-person at 1-190 (campus map).
Lecture notes
Download link (updated to Lecture 15)
2023 Course Schedule (tentative)
| Event | Course Date | Lecture | Reading | Logistic |
|---|---|---|---|---|
| Lecture 1 | Feb. 07 | Introduction slides | ||
| Lecture 2 | Feb. 09 | Simple Decision Making slides, video | Bandits: Chapter 6, 7, 8, 9; Contextual Bandits: Chapter 18, 19; LinUCB: paper. | |
| Lecture 3 | Feb. 14 | On-policy Learning slides, video | HW1 Released | |
| Lecture 4 | Feb. 16 | Variance Reduction in On-Policy Learning slides, video | ||
| Holiday | Feb. 21 | HW2 Released (No class) | ||
| Lecture 5 | Feb. 23 | Advanced Policy Gradients slides, video | ||
| Lecture 6 | Feb. 28 | Reward Design & Shaping slides, video | ||
| Lexture 7 | Mar. 02 | Learning from Demonstration slides, video | HW3 Released | |
| Lecture 8 | Mar. 07 | Learning from Demonstration (cont'd) reward design slides, learning from demonstrations slides, video | ||
| Lecture 9 | Mar. 09 | Learning from Demonstration (cont'd) video | HW4 Released | |
| Lecture 10 | Mar. 14 | Markov Assumption markov assumption slides, video | ||
| Lecture 11 | Mar. 16 | Transfer from Simulation to Real World slides, video | HW5 Released, Project Proposal Due | |
| Lecture 12 | Mar. 21 | Inverse Reinforcement Learning, Model-Based Reinforcement Learning slides, video | ||
| Lecture 13 | Mar. 23 | Model Learning model learning slides, video | HW6 Released | |
| Holiday | Mar. 28 | Spring break (No class) | ||
| Holiday | Mar. 30 | Spring break (No class) | ||
| Lecture 14 | Apr. 4 | Learning Forward and Inverse Models video | ||
| Lecture 15 | Apr. 6 | Tabular RL slides video | ||
| Lecture 16 | Apr. 11 | Deep Q-Learning slides, video | ||
| Lecture 17 | Apr. 13 | Deep Q-Learning video | HW8 Released | |
| Lecture 18 | Apr. 18 | Offline RL slides, video | Project Midterm Report Due | |
| Lecture 19 | Apr. 20 | Goal and Multi-Task Learning slides, video | ||
| Lecture 20 | Apr. 25 | Goal and Multi-Task Learning (cont'd) video | ||
| Lecture 21 | Apr. 27 | Hierarchical RL video | ||
| Lecture 22 | May. 02 | Curriculum Learning slides, video | ||
| Lecture 23 | May. 04 | Exploration in RL slides video | ||
| Lecture 24 | May 09 | Wrapping Up reading, video | ||
| Lecture 25 | May 11 | Project Presentations | video | |
| Lecture 26 | May 16 | Project Presentations |