Language & LLMs

What Is an Encoder-Decoder Architecture?

An encoder-decoder architecture uses an encoder to transform an input sequence into an internal representation and a decoder to produce an output sequence from it. This structure is common for sequence-to-sequence tasks such as translation and summarization. The decoder often uses cross-attention to reference the encoder's output.