CPS 271
Machine Learning

Meeting Schedule

Date Topic Homework Material
8/25/09 Introduction Read Chapter 1
Read NY Times Article on Statistics
Try matlab or octave in your work environment
intro.pdf
8/27/09 Review of Background Material I Read Chapter 2
(Skim 2.3.8, 2.5)
probreview.pdf
9/01/09 Review of Background Material II distributions.pdf
9/03/09 Probability Distributions Read Chapter 3 (skim 3.5, 3.6)
Read Lasso Paper
optimization.pdf
9/08/09 Linear Models for Regression Read Section 2.5
Read Smoothing by Local Regression: Principles and Methods
regression.pdf
9/10/09 Non-parametric methods Read Chapter 4 regularization.pdf
9/15/09 Linear Models for Classification HW2 assigned; due 9/24/09 hw1-comments
nonparametric.pdf
9/17/09 Slack Read Chapter 14 classifiers.pdf
Perceptron Demo
9/22/09 Decision Trees and Boosting Read Chapter 5 (skim 5.3.4-5.4.6, 5.6-5.7)
Read Schapire's Boosting Overview (Note that this is in postscript. You may need to install ghostview from the resources page.)
hw1-2-comments.pdf
dtrees.pdf
9/24/09 Neural Networks Reinforcement Learning Survey by Kaelbling et al. hw2-comments.pdf
neuralnet.pdf
9/29/09 Decision Theory and MDPs HW3 assigned; due 10/15/09
10/01/09 Slack exam-tips.pdf
mdp.pdf
10/06/09 Fall Break
10/08/09 Midterm
10/13/09 Reinforcement learning
10/15/09 Reinforcement Learning Read LSPI
Read linear models
rl.pdf
10/20/09 Reinforcement Learning Read Andrew Ng's Computational Learning Theory Notes
HW4 assigned; due 10/29/09
batchrl.pdf
10/22/09 Computational Learning Theory Read Chapter 6 (skim 6.3, 6.4.3, 6.4.4, 6.4.6) colt.pdf
10/27/09 Kernel Methods Read Chapter 7 (focus on 7.1) kernels.pdf
10/29/09 Sparse Kernel Machines svm.pdf
11/3/09 SVMs continued Read Chapter 12 (focus on 12.1)
Read the classic eigenfaces paper
HW5 assigned; due 11/12/09
11/5/09 Continuous Latent Variables Read Chapter 8 pca.pdf
11/10/09 Graphical Models Read Chapter 9
Read An Impossibility Theorem for Clustering
bnets.pdf
11/12/09 Mixture Models and EM Read Chapter 13 (skim 13.2.6 - 13.3.4) clusterem.pdf
11/17/09 Sequential Data (HMMs) Read Rabiner HMM Tutorial
HW6 assigned; due 12/03/09
hmm.pdf
11/19/09 More Graphical Models Skim Chapter 10. Read Chapter 11 (skim 11.4-11.6) graphicalmodels.pdf
11/24/09 Approximate Inference
11/26/09 Thanksgiving
12/01/09 Slack/optional material
12/03/09 slack/optional material
12/12/09 Final Exam 7:00 - 10:00 PM(!) in D106