Machine Learning & Training

What Is Batch Size?

Batch size is the number of training examples used in a single update of a model's parameters. Larger batches provide more stable gradient estimates but require more memory, while smaller batches add noise that can aid generalization. It is an important hyperparameter that affects training speed and stability.