CPS 570
Artificial Intelligence
(Emphasizing Planning and Sensing)

Meeting Schedule

Date Topic Homework Material
08/28/12 Lecture: Introduction Read Computing Machinery and Intelligence and Eye on the Prize
Optional reading: R&N chapters 1-2
intro.pdf
08/30/12 Discussion: Goals of AI hw1.pdf assigned, due 9/5
Optional reading: Chapter 8 of Algorithms by Dasgupta, Papadimitriou & Vazirani and
Reducibility Among Combinatorial Problems
goalsofai.pdf
9/4/12 Lecture: NP-Hardness Local Search Strategies for Satisfiability Testing and
Determining computational complexity from characteristic 'phase transitions'
nphardness.pdf
9/6/12 Discussion: SAT Solvers and Phase Transitions Optional material: Watch the begining of the submodularity tutorial, part I satsolvers.pdf
9/11/12 Lecture: Submodularity and Approximation hw2.pdf assigned, due 9/17
A brief overview of AI planning by Jussi Rintanen
Optional material: R&N chapter 10, Chapter 2 of LaValle's Planning text
approximation.pdf
9/13/12 Lecture: Classical Planning hw3.pdf assigned, due 9/25
Planning as Satisfiability
Deconstructing Planning as Satisfiability
planning.pdf
9/18/12 Discussion: SATPlan (Planning as Satisfiability) Real-Time Robot Motion Planning Using Rasterizing Computer Graphics Hardware satplan.pdf
9/20/12 Lecture: Robot Motion Planning SHOP: Simple Hierarchical Ordered Planner
Hierarchical Task and Motion Planning in the Now
motionplanning.pdf
9/25/12 Discussion: Hierarchical Planning Foundations of Computer Science Sections 4.9-4.12
Optional: The Cancer Cluster Myth
Optional: The Hot Hand in Basketball: On the Misperception of Random Sequences
hierplanning.pdf
9/27/12 Probabilties Kevin Murphy's Bayesian Network/Graphical Model Introdution probreview.pdf
10/2/12 Graphical Models I gmodels.pdf
10/4/12 Graphical Models II Rabiner HMM Tutorial
hw4.pdf assigned, due 10/10
10/9/12 Hiden Markov Models Active Learning for Hidden Markov Models
Optimal Nonmyopic Value of Information in Graphical Models - Efficient Algorithms and Theoretical Limits
hmms.pdf
10/11/12 Discussion: Query planning in HMMs and graphical models hw5 assigned
due 10/22
QueryPlanning.pdf
10/18/12 Slack (catch up) Read the first two chapters of Michael Littman's Thesis
10/23/12 Lecture: Decision Theory dt.pdf
10/25/12 Lecture: MDPs Read Reinforcement Learning: A Survey, focusing on sections 1-6 mdp.pdf
10/30/12 Lecture: Reinforcement Learning Read Optimizing Dialog Management with Reinforcement Learning
Read Temporal Difference Learning and TD-Gammon
rl.pdf
11/01/12 Midterm
11/6/12 Slack hw6 assigned, due 11/7
11/8/12 Discussion: MDP/RL Applications Read Recent Advances in Hierarchical Reinforcement Learning, focusing on sections 1-4
hw7 assigned, due 11/12
mdpapps.pdf
11/13/12 Discussion: Hierarchical Reinforcement Learning Read Linear Programming, A Concise Introduction, sections 1 and 2
Read Game Theory, sections 1 and 2
rl-hierarchy.pdf
11/15/12 Lecture: Game Theory and Linear Programming Read Multi-step Multi-sensor Hider Seeker Games
hw8 assigned, due 11/19
lpandgames.pdf
11/20/12 Discussion: Query Planning as a Game Read Witness Algorithm Technical Report focusing on sections 1-5 sensorgame.pdf
11/27/12 Lecture: POMDPs Read Point Based Value Iteration
Read Non-myopic Multiaspect Sensing with POMDPs
hw9 assigned, due 11/28
pomdps.pdf
11/29/12 Discussion: Point Based Methods and Applications pbviapps.pdf
12/11/12 Final Exam 2:00 - 5:00