Gemini 3.8 Flash vs GPT-6 Sol: Benchmark Comparison

Gemini 3.8 Flash has the higher score on 7 of 18 shared benchmarks; GPT-6 Sol leads on 11.

The largest observed score gap is 35.00 pts on ProofBench v1.1 , where GPT-6 Sol leads.

Reported ±1 standard-error ranges overlap on 4 of 17 shared benchmarks with comparable uncertainty data. This is not a pairwise statistical significance test.

Shared benchmark results

Scores and reported standard errors come from the latest visible Vals benchmark version available for both models.

Benchmark Gemini 3.8 Flash GPT-6 Sol Gap Reported uncertainty
Vals RSI Index 19.93% 28.11% 8.18 pts Uncertainty comparison unavailable
Vals Science Index 35.76% ±1.66 45.00% ±2.26 9.24 pts Reported ±1 SE ranges do not overlap
Legal Research Bench 38.94% ±3.39 28.85% ±3.15 10.10 pts Reported ±1 SE ranges do not overlap
Tax Agent Bench 32.12% ±3.37 15.00% ±2.58 17.12 pts Reported ±1 SE ranges do not overlap
MedCode 48.13% ±2.18 47.07% ±2.12 1.06 pts Reported ±1 SE ranges overlap
MedScribe 84.50% ±1.94 82.03% ±1.94 2.46 pts Reported ±1 SE ranges overlap
ProofBench v1.1 48.00% ±5.02 83.00% ±3.77 35.00 pts Reported ±1 SE ranges do not overlap
BioMysteryBench 62.22% ±1.70 74.81% ±2.43 12.59 pts Reported ±1 SE ranges do not overlap
MysteryMechanism 36.49% ±3.24 30.18% ±3.09 6.31 pts Reported ±1 SE ranges overlap
Terminal-Bench-Science 8.57% ±3.37 30.00% ±5.52 21.43 pts Reported ±1 SE ranges do not overlap
IOI 56.94% ±2.26 82.61% ±9.24 25.67 pts Reported ±1 SE ranges do not overlap
ProgramBench 1.00% ±0.70 2.00% ±0.99 1.00 pts Reported ±1 SE ranges overlap
Terminal-Bench 4.0 19.70% ±2.31 44.44% ±3.54 24.75 pts Reported ±1 SE ranges do not overlap
Vibe Code Bench v1.1 78.65% ±3.88 87.82% ±2.53 9.17 pts Reported ±1 SE ranges do not overlap
CyberBench v1.1 43.75% ±2.21 77.98% ±5.11 34.23 pts Reported ±1 SE ranges do not overlap
SRE Bench 11.07% ±1.94 30.53% ±2.85 19.46 pts Reported ±1 SE ranges do not overlap
Financial Coaching Bench 66.27% ±1.58 62.61% ±1.72 3.66 pts Reported ±1 SE ranges do not overlap
Public Benefits Bench v1.1 65.29% ±1.24 56.63% ±1.29 8.66 pts Reported ±1 SE ranges do not overlap

Performance by category

Category Gemini 3.8 Flash average GPT-6 Sol average
Legal 38.94% 28.85%
Finance 32.12% 15.00%
Healthcare 66.32% 64.55%
Math 48.00% 83.00%
Science 35.76% 45.00%
Coding 39.07% 54.22%
Cyber 27.41% 54.25%
Social Mobility 65.78% 59.62%

Cost and latency

Cost per test appears only where the benchmark reports it for both models. Latency is the measured completion time for that benchmark.

Benchmark Gemini 3.8 Flash cost GPT-6 Sol cost Gemini 3.8 Flash latency GPT-6 Sol latency
Vals RSI Index $332.04 $665.11 90h00m 90h00m
Vals Science Index $2.98 $2.31 22m00s 31m16s
Legal Research Bench $1.63 $4.90 5m24s 24m09s
Tax Agent Bench $0.86 $2.28 2m58s 17m32s
MedCode N/A N/A 42.89s 62.71s
MedScribe N/A N/A 21.14s 81.14s
ProofBench v1.1 $0.60 $0.48 6m09s 5m05s
BioMysteryBench $1.55 $0.66 5m27s 5m24s
MysteryMechanism $1.73 $0.46 5m22s 6m13s
Terminal-Bench-Science $5.64 $5.82 55m11s 1h22m
IOI $3.98 $2.70 14m20s 30m38s
ProgramBench $10.93 $11.67 46m39s 46m11s
Terminal-Bench 4.0 $8.65 $5.79 1h47m 34m56s
Vibe Code Bench v1.1 $6.87 $26.36 8m39s 38m56s
CyberBench v1.1 $1.96 $1.34 9m49s 12m14s
SRE Bench $27.46 $20.65 2h28m 1h03m
Financial Coaching Bench $0.10 $0.23 115.20s 6m51s
Public Benefits Bench v1.1 $1.01 $2.49 3m21s 31m02s

Results available only for Gemini 3.8 Flash

  • Vals Index
  • Vals Finance Index
  • Vals Legal Index
  • HLAB-Vals-1.1
  • Immigration
  • LegalBench
  • EMB v1.1
  • Finance Agent v2.1
  • MortgageTax
  • TaxEval v2
  • GPQA Diamond
  • MMLU Pro
  • MMMU Pro
  • SAGE
  • Code Migration v1.1
  • LiveCodeBench
  • SkillsBench
  • SWE-bench
  • SWE-bench Multimodal
  • Access to Justice Benchmark
  • CUA-bench
  • Time Horizon Index: KSP

Results available only for GPT-6 Sol

None.

Model details Gemini 3.8 Flash Model details GPT-6 Sol