Gemini 3.7 Flash vs Muse Spark 1.3: Benchmark Comparison

Gemini 3.7 Flash has the higher score on 4 of 9 shared benchmarks; Muse Spark 1.3 leads on 5.

The largest observed score gap is 25.66 pts on CyberBench v1.1 , where Muse Spark 1.3 leads.

Reported ±1 standard-error ranges overlap on 5 of 9 shared benchmarks with comparable uncertainty data. This is not a pairwise statistical significance test.

Shared benchmark results

Scores and reported standard errors come from the latest visible Vals benchmark version available for both models.

Benchmark Gemini 3.7 Flash Muse Spark 1.3 Gap Reported uncertainty
Legal Research Bench 34.62% ±3.31 40.87% ±3.42 6.25 pts Reported ±1 SE ranges overlap
Tax Agent Bench 22.80% ±3.03 35.97% ±3.42 13.18 pts Reported ±1 SE ranges do not overlap
ProofBench v1.1 58.00% ±4.96 55.00% ±5.00 3.00 pts Reported ±1 SE ranges overlap
Terminal-Bench-Science 7.14% ±3.10 4.29% ±2.44 2.86 pts Reported ±1 SE ranges overlap
IOI 67.83% ±3.61 43.94% ±1.45 23.89 pts Reported ±1 SE ranges do not overlap
ProgramBench 0.00% ±0.00 0.50% ±0.50 0.50 pts Reported ±1 SE ranges overlap
Terminal-Bench 4.0 12.12% ±3.03 10.61% ±1.75 1.52 pts Reported ±1 SE ranges overlap
Vibe Code Bench v1.1 70.39% ±4.84 82.86% ±2.90 12.46 pts Reported ±1 SE ranges do not overlap
CyberBench v1.1 43.75% ±2.21 69.41% ±5.76 25.66 pts Reported ±1 SE ranges do not overlap

Performance by category

Category Gemini 3.7 Flash average Muse Spark 1.3 average
Legal 34.62% 40.87%
Finance 22.80% 35.97%
Math 58.00% 55.00%
Science 7.14% 4.29%
Coding 37.59% 34.48%
Cyber 43.75% 69.41%

Cost and latency

Cost per test appears only where the benchmark reports it for both models. Latency is the measured completion time for that benchmark.

Benchmark Gemini 3.7 Flash cost Muse Spark 1.3 cost Gemini 3.7 Flash latency Muse Spark 1.3 latency
Legal Research Bench $0.76 $0.65 4m49s 8m51s
Tax Agent Bench $0.48 $0.32 87.24s 8m25s
ProofBench v1.1 $0.56 $0.43 7m04s 8m54s
Terminal-Bench-Science $7.19 $4.41 1h20m 1h08m
IOI $3.40 $2.36 21m09s 29m51s
ProgramBench $7.13 $11.56 21m30s 1h09m
Terminal-Bench 4.0 $8.71 $7.04 1h24m 1h59m
Vibe Code Bench v1.1 $4.83 $2.10 23m43s 12m54s
CyberBench v1.1 $2.15 $4.26 7m34s 24m53s

Results available only for Gemini 3.7 Flash

  • Vals RSI Index
  • LegalBench
  • MortgageTax
  • TaxEval v2
  • MedCode
  • MedScribe
  • GPQA Diamond
  • MMLU Pro
  • MMMU Pro
  • SAGE
  • LiveCodeBench
  • SkillsBench
  • SWE-bench
  • SRE Bench

Results available only for Muse Spark 1.3

None.

Model details Gemini 3.7 Flash Model details Muse Spark 1.3