Machine Learning & Training

What Is an Activation Function?

An activation function is a mathematical operation applied to the output of a neuron that introduces non-linearity into a neural network. Without activation functions, a network would only be able to represent linear relationships. Common examples include ReLU, sigmoid, and tanh.