Language & LLMs

What Is GPT-3?

GPT-3 is a large language model developed by OpenAI that generates text by predicting the next token in a sequence. It is notable for performing many tasks through in-context learning, where examples are provided in the prompt rather than through fine-tuning. It significantly scaled up the number of parameters compared to earlier GPT models.