Think
LLM
Models
Capabilities
Use Cases
Benchmarks
Papers
Glossary
Search
/
Glossary
/
Token Budget
Token Budget
techniques
The maximum number of tokens available to include retrieved context in a language model prompt.
Token Budget — Glossary — ThinkLLM