Qwen 3.7 Plus vs Gemini 3.1 Pro Preview (02/26): Benchmark Comparison

Qwen 3.7 Plus has the higher score on 2 of 9 shared benchmarks; Gemini 3.1 Pro Preview (02/26) leads on 6.

The largest observed score gap is 14.36 pts on Vibe Code Bench v1.1 , where Qwen 3.7 Plus leads.

Reported ±1 standard-error ranges overlap on 5 of 9 shared benchmarks with comparable uncertainty data. This is not a pairwise statistical significance test.

Shared benchmark results

Scores and reported standard errors come from the latest visible Vals benchmark version available for both models.

Benchmark Qwen 3.7 Plus Gemini 3.1 Pro Preview (02/26) Gap Reported uncertainty
Harvey's Legal Agent Benchmark 0.00% ±0.00 0.00% ±0.00 0.00 pts Reported ±1 SE ranges overlap
Legal Research Bench 16.35% ±2.57 20.67% ±2.81 4.33 pts Reported ±1 SE ranges overlap
EMB 49.34% ±3.18 52.62% ±2.97 3.27 pts Reported ±1 SE ranges overlap
Finance Agent (v2) 38.22% ±1.04 42.98% ±1.21 4.76 pts Reported ±1 SE ranges do not overlap
MortgageTax 66.18% ±0.93 69.40% ±0.91 3.22 pts Reported ±1 SE ranges do not overlap
Tax Agent Bench 38.71% ±2.81 37.84% ±3.10 0.87 pts Reported ±1 SE ranges overlap
SAGE 39.25% ±3.38 48.68% ±3.29 9.43 pts Reported ±1 SE ranges do not overlap
Code Migration 12.86% ±2.93 17.31% ±3.93 4.46 pts Reported ±1 SE ranges overlap
Vibe Code Bench v1.1 46.39% ±4.61 32.03% ±4.34 14.36 pts Reported ±1 SE ranges do not overlap

Performance by category

Category Qwen 3.7 Plus average Gemini 3.1 Pro Preview (02/26) average
Legal 8.17% 10.34%
Finance 48.11% 50.71%
Education 39.25% 48.68%
Coding 29.62% 24.67%

Cost and latency

Cost per test appears only where the benchmark reports it for both models. Latency is the measured completion time for that benchmark.

Benchmark Qwen 3.7 Plus cost Gemini 3.1 Pro Preview (02/26) cost Qwen 3.7 Plus latency Gemini 3.1 Pro Preview (02/26) latency
Harvey's Legal Agent Benchmark $0.23 $1.15 8m49s 7m17s
Legal Research Bench $0.30 $1.10 13m52s 4m02s
EMB $0.60 $3.77 36m49s 11m49s
Finance Agent (v2) $0.36 $1.59 9m02s 3m28s
MortgageTax N/A N/A 60.55s 23.62s
Tax Agent Bench $0.09 $0.30 5m10s 100.96s
SAGE N/A N/A 2m57s 61.17s
Code Migration $0.42 $1.61 35m47s 12m01s
Vibe Code Bench v1.1 $1.08 $3.83 37m12s 20m12s

Results available only for Qwen 3.7 Plus

  • SkillsBench

Results available only for Gemini 3.1 Pro Preview (02/26)

  • Vals Index
  • LegalBench
  • TaxEval v2
  • MedCode
  • MedScribe
  • ProofBench v1.1
  • BioMysteryBench
  • MysteryMechanism
  • Terminal-Bench Science
  • GPQA Diamond
  • MMLU Pro
  • MMMU Pro
  • IOI
  • LiveCodeBench
  • ProgramBench
  • SWE-bench
  • Terminal-Bench 4.0
  • Vibe Code Bench 1-100
  • Public Benefits Bench v1.1
Model details Qwen 3.7 Plus Model details Gemini 3.1 Pro Preview (02/26)