Think
LLM
Models
Capabilities
Use Cases
Benchmarks
Papers
Glossary
Search
/
Glossary
/
Group Wise Quantization
Group Wise Quantization
techniques
Reducing model size by compressing weights in groups rather than individually.
Group Wise Quantization — Glossary — ThinkLLM