Like local search: move a little in the direction that improves the error measure.
Uses calculus to figure out which way is best in the continuous space.
