Gemma 2 9B IT is Google's mid-sized instruction-tuned model that punches above its weight class for text tasks. It handles reasoning, summarization, and Q&A with notable coherence for a sub-10B model, though it can struggle with complex multi-step logic that larger models handle more gracefully. Its open-weight nature means it runs locally on consumer hardware, making it a practical choice for developers who need a capable text model without cloud dependencies.
| Benchmark | Score | Type | Recorded |
|---|---|---|---|
| MMLU-Pro | 31.9 | accuracy | 24d ago |
| MATH | 19.5 | accuracy | 24d ago |
| MuSR | 9.7 | accuracy | 24d ago |
| BBH | 42.1 | accuracy | 24d ago |
| GPQA Diamond | 14.8 | accuracy | 24d ago |
| IFEval | 74.4 | accuracy | 24d ago |