Language & LLMs

What Is a Word Embedding?

A word embedding is a dense vector of numbers that represents a word so that its position captures aspects of its meaning and usage. Words with similar meanings tend to have similar embeddings, enabling machines to measure semantic relationships mathematically. Popular embedding methods include word2vec and GloVe.