Think
LLM
Models
Capabilities
Use Cases
Benchmarks
Papers
Glossary
Search
/
Attention Sink — Glossary — ThinkLLM
Glossary
/
Attention Sink
Attention Sink
techniques
A token that attracts excessive attention from the model regardless of its semantic importance.