Think
LLM
Models
Capabilities
Use Cases
Benchmarks
Papers
Glossary
Search
/
Glossary
/
Token Representations
Token Representations
architecture
Numerical vectors that encode the meaning of individual words or subword units within a text.
Token Representations — Glossary — ThinkLLM