Activation Functions

To get increased computational power from multiple neurons, need nonlinear activation functions. Examples:

• Step function
• Sign function
• Sigmoid function

Good: can represent more complex functions

Bad: harder to train