Think
LLM
Models
Capabilities
Use Cases
Benchmarks
Papers
Glossary
Search
/
Glossary
/
Token Throughput
Token Throughput
techniques
The number of tokens a model can generate per unit of time during inference.
Token Throughput — Glossary — ThinkLLM