Language & LLMs

What Is Sparse Retrieval?

Sparse retrieval finds documents by matching query terms against document terms, using weighted scores based on word frequency. Methods like BM25 fall into this category, representing text with sparse, mostly-zero vectors. It is effective and efficient but can miss semantically related results that use different words.