Attention Sink
In many trained decoder-only transformers, a large share of the attention in many heads goes to the first few tokens of the sequence, whatever those tokens say.
In many trained decoder-only transformers, a large share of the attention in many heads goes to the first few tokens of the sequence, whatever those tokens say.