Gemma 3 12B Instruct vs GPT-5.1
Google vs OpenAI — benchmarks, pricing, and capabilities side by side.
- •GPT-5.1 has the higher intelligence index (89 vs 40)
- •Gemma 3 12B Instruct is cheaper ($0.10 vs $1.25 per 1M input)
| Gemma 3 12B Instruct | GPT-5.1 | |
|---|---|---|
| Intelligence index | 40 | 89 |
| Developer | OpenAI | |
| Type | LLM | LLM |
| Access | — | API only |
| Context window | — | 400,000 tokens |
| Input price | $0.10 / 1M | $1.25 / 1M |
| Output price | $0.30 / 1M | $10.00 / 1M |
| Speed | — | 115 tok/s |
| Released | March 12, 2025 | November 12, 2025 |
| Parameters | — | — |
| Input modalities | — | Text, Image |
| Output modalities | — | Text |
Shared benchmarks
Gemma 3 12B Instruct
GPT-5.1
AIME 2025
18.3
94
GPQA Diamond
34.9
88.1
Humanity’s Last Exam
4.8
26.5
LiveCodeBench
13.7
86.8
MMLU-Pro
59.5
87