Language & LLMs

What Is Bag of Words?

Bag of words is a simple text representation that counts how often each word appears in a document, disregarding order and grammar. Each document becomes a vector of word frequencies over a vocabulary. It is easy to compute but loses information about word sequence and context.