Think
LLM
Models
Capabilities
Use Cases
Benchmarks
Papers
Glossary
Search
/
Glossary
/
Softmax
Softmax
techniques
A mathematical function that converts attention scores into probabilities that sum to one.
Learn more on Wikipedia
Softmax — Glossary — ThinkLLM