Machine Learning & Training

What Is ReLU?

ReLU, or rectified linear unit, is a widely used activation function that outputs the input directly if it is positive and zero otherwise. Its simplicity makes it efficient to compute and helps mitigate the vanishing gradient problem. ReLU is a default choice for many deep neural network architectures.