Gemini 3.1 Pro Preview (02/26) vs Inkling Small: Benchmark Comparison

Gemini 3.1 Pro Preview (02/26) has the higher score on 11 of 18 shared benchmarks; Inkling Small leads on 7.

The largest observed score gap is 42.50 pts on IOI , where Gemini 3.1 Pro Preview (02/26) leads.

Reported ±1 standard-error ranges overlap on 3 of 18 shared benchmarks with comparable uncertainty data. This is not a pairwise statistical significance test.

Open interactive comparison Read the methodology

Shared benchmark results

Scores and reported standard errors come from the latest visible Vals benchmark version available for both models.

Benchmark Gemini 3.1 Pro Preview (02/26) Inkling Small Gap Reported uncertainty
Legal Research Bench 20.67% ±2.81 25.48% ±3.03 4.81 pts Reported ±1 SE ranges overlap
LegalBench 87.40% ±0.33 82.99% ±0.46 4.41 pts Reported ±1 SE ranges do not overlap
MortgageTax 69.40% ±0.91 62.28% ±0.95 7.11 pts Reported ±1 SE ranges do not overlap
Tax Agent Bench 9.29% ±2.09 15.39% ±2.37 6.09 pts Reported ±1 SE ranges do not overlap
TaxEval v2 72.88% ±0.86 75.51% ±0.84 2.63 pts Reported ±1 SE ranges do not overlap
MedCode 59.06% ±2.00 37.89% ±2.21 21.17 pts Reported ±1 SE ranges do not overlap
MedScribe 76.11% ±1.92 84.11% ±1.87 8.00 pts Reported ±1 SE ranges do not overlap
ProofBench v1.1 26.00% ±4.41 6.00% ±2.39 20.00 pts Reported ±1 SE ranges do not overlap
GPQA Diamond 95.45% ±1.05 83.59% ±2.04 11.87 pts Reported ±1 SE ranges do not overlap
MMLU Pro 90.99% ±0.28 85.57% ±0.35 5.42 pts Reported ±1 SE ranges do not overlap
SAGE 48.68% ±3.29 32.74% ±3.26 15.93 pts Reported ±1 SE ranges do not overlap
IOI 51.83% ±2.59 9.33% ±4.47 42.50 pts Reported ±1 SE ranges do not overlap
LiveCodeBench 88.48% ±0.93 85.93% ±0.99 2.55 pts Reported ±1 SE ranges do not overlap
ProgramBench 0.00% ±0.00 0.50% ±0.50 0.50 pts Reported ±1 SE ranges overlap
SWE-bench 78.80% ±1.83 82.20% ±1.71 3.40 pts Reported ±1 SE ranges overlap
Terminal-Bench 4.0 2.52% ±0.51 0.00% ±0.00 2.52 pts Reported ±1 SE ranges do not overlap
Vibe Code Bench v1.1 32.03% ±4.34 19.05% ±3.40 12.98 pts Reported ±1 SE ranges do not overlap
Public Benefits Bench v1.1 53.79% ±1.30 59.41% ±1.28 5.62 pts Reported ±1 SE ranges do not overlap

Performance by category

Category Gemini 3.1 Pro Preview (02/26) average Inkling Small average
Legal 54.04% 54.23%
Finance 50.52% 51.06%
Healthcare 67.59% 61.00%
Math 26.00% 6.00%
Academic 93.22% 84.58%
Education 48.68% 32.74%
Coding 42.28% 32.84%
Social Mobility 53.79% 59.41%

Cost and latency

Cost per test appears only where the benchmark reports it for both models. Latency is the measured completion time for that benchmark.

Benchmark Gemini 3.1 Pro Preview (02/26) cost Inkling Small cost Gemini 3.1 Pro Preview (02/26) latency Inkling Small latency
Legal Research Bench $1.10 $0.14 4m02s 12m55s
LegalBench N/A N/A 10.06s 17.66s
MortgageTax N/A N/A 23.62s 112.21s
Tax Agent Bench $0.30 $0.09 100.96s 6m25s
TaxEval v2 N/A N/A 41.93s 4m02s
MedCode N/A N/A 38.52s 3m11s
MedScribe N/A N/A 69.14s 3m50s
ProofBench v1.1 $0.78 $0.08 14m49s 8m27s
GPQA Diamond N/A N/A 65.76s 4m20s
MMLU Pro N/A N/A 23.91s 71.69s
SAGE N/A N/A 61.17s 3m26s
IOI $1.25 $0.34 12m03s 11m18s
LiveCodeBench N/A N/A 88.89s 5m02s
ProgramBench $2.63 $0.48 12m36s 28m31s
SWE-bench $0.78 $0.13 5m12s 4m05s
Terminal-Bench 4.0 $4.11 $0.32 18m44s 11m45s
Vibe Code Bench v1.1 $3.83 $0.43 20m12s 49m09s
Public Benefits Bench v1.1 $0.38 $0.10 3m06s 8m41s

Results available only for Gemini 3.1 Pro Preview (02/26)

  • Vals Science Index
  • BioMysteryBench
  • MysteryMechanism
  • Terminal-Bench-Science
  • MMMU Pro
  • Vibe Code Bench 1-100
  • SRE Bench

Results available only for Inkling Small

  • Vals Finance Index
  • Vals Index
  • Vals Legal Index
  • HLAB-Vals-1.1
  • EMB v1.1
  • Finance Agent v2.1
  • Code Migration v1.1
  • SkillsBench
  • CyberBench v1.1
Model details Gemini 3.1 Pro Preview (02/26) Model details Inkling Small