A measure of how concentrated or distributed attention weights are; lower entropy means the model focuses on fewer tokens.