Think
LLM
Models
Capabilities
Use Cases
Benchmarks
Papers
Glossary
Search
/
Glossary
/
Massive Activations
Massive Activations
techniques
Extreme outlier values in a small number of tokens and channels within a neural network layer.
Massive Activations — Glossary — ThinkLLM