Transformer
The neural-network architecture behind virtually every modern language model.
A Transformer stacks layers of attention and feed-forward networks with residual connections and layer normalization. Unlike RNNs it processes a whole sequence in parallel, which is what made training on internet-scale text practical. Decoder-only Transformers (GPT-style) generate text left-to-right; encoder-only ones (BERT) build representations for understanding.