Language & LLMs

What Is Perplexity as a Metric?

Perplexity is a metric that quantifies how well a language model predicts a sample of text. It is related to the model's uncertainty, with lower values meaning the model assigns higher probability to the observed sequence. It is commonly used to compare language models on a test set.