Language & LLMs

What Is Long Context?

Long context describes language models capable of handling very large numbers of tokens in a single request. This lets them work with long documents, extended conversations, or large codebases at once. Achieving long context requires efficient attention methods and careful memory management.