Neural Network Neckties: Activation Functions

Where function and form come together in perfect harmony.

• ReLU: The Most Popular Kid on the Block
• Leaky ReLU: The Drama Queen
• Softmax: The Gentleman