Machine Learning & Training

What Is a Mini-Batch?

A mini-batch is a small subset of the training dataset used to compute a single gradient update. Mini-batch training strikes a balance between the noisy updates of pure stochastic gradient descent and the heavy computation of full-batch methods. It is the standard approach for training most neural networks.