Lectures (Spring 2021)
Lecture Logistics#
Lectures will be held over Zoom, then posted to Youtube. For the Zoom link, please refer to the course Piazza.
Course Schedule#
| Event | Date | Lecture | Readings | Logistics |
|---|---|---|---|---|
| Lecture | 02/16/2021 | Introduction [video] [slides] | ||
| Lecture | 02/18/2021 | Simple Decision Making [video] [slides] | Bandits: Chapter 6, 7, 8, 9 Contextual Bandits: Chapter 18, 19 LinUCB: paper | HW1 Released |
| Lecture | 02/23/2021 | Solving Sequential Decision Making in Tabular Setups [video] [slides 1] [slides 2] | ||
| Lecture | 02/25/2021 | Deep Q-Learning [video] [slides] | HW2 Released | |
| Lecture | 03/02/2021 | Simulators, Benchmarks and Large Scale Experiments [video] [slides] | ||
| Lecture | 03/04/2021 | On-policy Learning [video] [slides] | HW3 Released | |
| Holiday | 03/09/2021 | No class | ||
| Lecture | 03/11/2021 | Advanced Policy Gradients [video] [slides] | HW4 Released | |
| Lecture | 03/16/2021 | Reward Design & Shaping [video] [slides] | ||
| Lecture | 03/18/2021 | Advanced Deep Learning Topics [video] [slides] | HW5 Released Project Proposal Due | |
| Holiday | 03/23/2021 | Student Holiday (No class) | ||
| Lecture | 03/25/2021 | Transfer from Simulation to Real World [video] [slides] | ||
| Lecture | 03/30/2021 | Lifelong and Transfer Learning [video] [slides] | ||
| Lecture | 04/01/2021 | Imitation Learning [video] [slides] | HW6 Released | |
| Lecture | 04/06/2021 | Inverse Reinforcement Learning [video] [slides] | ||
| Lecture | 04/08/2021 | Learning with Models [video] [slides] | HW7 Released | |
| Lecture | 04/13/2021 | Self-Supervised Learning [video] [slides] | ||
| Lecture | 04/15/2021 | Self-Supervised Learning Part 2 [video] [slides 1] [slides 2] | Project Midterm Report Due | |
| Holiday | 04/20/2021 | Patriots Day (Holiday) | ||
| Lecture | 04/22/2021 | Doing for our robots what nature did for us (Guest lecture with Leslie Kaelbling) [video] [slides] | ||
| Lecture | 04/27/2021 | Task Specification Problem [video] [slides] | HW8 Released | |
| Lecture | 04/29/2021 | Curriculum Learning and Exploration [video] [slides] | ||
| Lecture | 05/04/2021 | Exploration, Offline RL and Self-Play I [video] [slides] | ||
| Lecture | 05/06/2021 | Exploration, Offline RL and Self-Play II [video] [slides] | ||
| Lecture | 05/11/2021 | Guest lecture with Cathy Wu [video] | ||
| Lecture | 05/13/2021 | Wrapping up [video] [slides] | ||
| Lecture | 05/18/2021 | Project Presentations [video] | ||
| Lecture | 05/20/2021 | Project Presentations [video] | Project Final Report Due |