Calendar

Subject to change.

Planning Foundations

Sep 2
LectureIntro
PDF
Sep 4
LectureOffline Planning in MDPs
PDF | PPT
Sep 8
HWHW0 Due
PDF | LaTeX
Sep 9
LectureOnline Planning in MDPs
PDF | PPT
Sep 11
LectureMonte Carlo Methods
PDF | PPT
Sep 16
HWHW1 Due
PDF | LaTeX
LecturePartial Observability
PDF | PPT
Sep 18
LecturePlanning and RL
PDF | PPT
Sep 23
HWHW2 Due
PDF | LaTeX
LecturePlanning in Factored Spaces
PDF | PPT
Sep 25
LectureMotion Planning
PDF | PPT
Sep 30
LectureTrajectory Optimization
PDF | PPT
Oct 2
LectureHierarchy and Abstraction
PDF | PPT
Oct 6
ProjectFinal Project Proposal Due
PDF | LaTeX
Oct 7
LectureBuffer Lecture
Oct 9
LectureGuest Lecture (Yixuan Huang)
Oct 10
HWHW3 Due
PDF | LaTeX

Learning to Make Planning Possible

Oct 14
No Class (Fall Recess)
Oct 16
No Class (Fall Recess)
Oct 20
HWPre-Class Paper Reviews Due
PDF | LaTeX
Oct 21
PapersLearning Latent Space Models for Motion Planning
“Robot motion planning in learned latent spaces” (Ichter & Pavone, 2019)
PDF
“Latent planning via expansive tree search” (Gieselmann & Pokorny, 2022)
PDF
“Motion planning by learning the solution manifold in trajectory optimization” (Osa, 2022)
PDF
Oct 22
HWPre-Class Paper Reviews Due
PDF | LaTeX
Oct 23
PapersLearning Latent Space Models for TrajOpt
“Embed to control: a locally linear latent dynamics model for control from raw images” (Watter et al., 2015)
PDF
“Dream to control: learning behaviors by latent imagination” (Hafner et al., 2020)
PDF
“Guaranteed discovery of controllable latent states with multi-step inverse models” (Lamb et al., 2022)
PDF
Oct 27
HWPre-Class Paper Reviews Due
PDF | LaTeX
Oct 28
PapersLearning Models for Task and Motion Planning
“Predicate invention for bilevel planning” (Silver et al., 2023)
PDF
“From real world to logic and back: learning generalizable relational concepts for long horizon robot planning” (Shah et al., 2025)
PDF
“VisualPredicator: learning abstract world models with neuro-symbolic predicates for robot planning” (Liang et al., 2025)
PDF
Oct 30
No Class
Use the extra time to work on final projects!
Oct 31
ProjectProject Update 1 Due
PDF | LaTeX

Learning to Make Planning Fast

Nov 3
HWPre-Class Paper Reviews Due
PDF | LaTeX
Nov 4
PapersLearning to Guide MCTS
“Mastering the game of Go with deep neural networks and tree search” (Silver et al., 2016)
PDF
“Mastering chess and shogi by self-play with a general reinforcement learning algorithm” (Silver et al., 2017)
PDF
“Mastering atari, go, chess and shogi by planning with a learned model” (Schrittwieser et al., 2019)
PDF
Nov 5
HWPre-Class Paper Reviews Due
PDF | LaTeX
Nov 6
PapersLearning Samplers for Motion Planning and TAMP
“Motion planning networks: bridging the gap between learning-based and classical motion planners” (Qureshi et al., 2020)
PDF
“Learning constrained distributions of robot configurations with generative adversarial networks” (Lembono et al., 2021)
PDF
“Compositional diffusion-based continuous constraint solvers” (Yang et al., 2023)
PDF
Nov 10
HWPre-Class Paper Reviews Due
PDF | LaTeX
Nov 11
PapersClassical Planning with LLMs
“LLMs can’t plan, but can help planning in LLM-Modulo frameworks” (Kambhampati et al., 2024)
PDF
“Generalized planning in PDDL domains with pretrained large language models” (Silver et al., 2023)
PDF
“Classical planning with LLM-generated heuristics: challenging the state of the art with python code” (Corrêa et al., 2025)
PDF
Nov 12
HWPre-Class Paper Reviews Due
PDF | LaTeX
Nov 13
PapersPlanning with VLAs
“CoT-VLA: Visual Chain-of-Thought Reasoning for Vision-Language-Action Models” (Zhao et al., 2025)
PDF
“Hi Robot: Open-Ended Instruction Following with Hierarchical Vision-Language-Action Models” (Shi et al., 2025)
PDF
“MolmoAct: Action Reasoning Models that can Reason in Space” (Lee et al., 2025)
PDF
Nov 17
HWPre-Class Paper Reviews Due
PDF | LaTeX
Nov 18
PapersLearning Factored State Abstractions
“State abstraction discovery from irrelevant state variables” (Jong & Stone, 2005)
PDF
“Planning with learned object importance in large problem instances using graph neural networks” (Silver et al., 2021)
PDF
“CAMPs: learning context-specific abstractions for efficient planning in factored MDPs” (Chitnis et al., 2020)
PDF
Nov 19
HWPre-Class Paper Reviews Due
PDF | LaTeX
Nov 20
PapersLearning Action Abstractions (Options)
“Between MDPs and semi-MDPs: A framework for temporal abstraction in reinforcement learning” (Sutton et al., 1999)
PDF
“Diversity is all you need: learning skills without a reward function” (Eysenbach et al., 2018)
PDF
“Finding options that minimize planning time” (Jinnai et al., 2019)
PDF
Nov 24
ProjectProject Update 2 Due
PDF | LaTeX
Nov 25
No Class (Thanksgiving Recess)
Nov 27
No Class (Thanksgiving Recess)

Planning to Learn

Dec 1
HWPre-Class Paper Reviews Due
PDF | LaTeX
Dec 2
PapersExploration + Planning
“Exploration in model-based reinforcement learning by empirically estimating learning progress” (Lopes et al., 2012)
PDF
“Curiosity-driven exploration by self-supervised prediction” (Pathak et al., 2017)
PDF
“Trial and error: exploration-based trajectory optimization for LLM agents” (Song et al., 2024)
PDF
Dec 3
HWPre-Class Paper Reviews Due
PDF | LaTeX
Dec 4
PapersPlanning to Learn with Human-in-the-Loop
“Asking for help using inverse semantics” (Knepper et al., 2014)
PDF
“Human-in-the-loop task and motion planning for imitation learning” (Mandlekar et al., 2023)
PDF
“To ask or not to ask: human-in-the-loop contextual bandits with applications in robot-assisted feeding” (Banerjee et al., 2024)
PDF
Dec 15
ProjectFinal Project Due
PDF