Gemini 3.8 Flash vs Muse Spark 1.3: Benchmark Comparison
Gemini 3.8 Flash has the higher score on 4 of 12 shared benchmarks; Muse Spark 1.3 leads on 8.
The largest observed score gap is 25.66 pts on CyberBench v1.1 , where Muse Spark 1.3 leads.
Reported ±1 standard-error ranges overlap on 7 of 12 shared benchmarks with comparable uncertainty data. This is not a pairwise statistical significance test.
Shared benchmark results
Scores and reported standard errors come from the latest visible Vals benchmark version available for both models.
| Benchmark | Gemini 3.8 Flash | Muse Spark 1.3 | Gap | Reported uncertainty |
|---|---|---|---|---|
| Immigration | 63.41% ±1.61 | 65.00% ±1.56 | 1.59 pts | Reported ±1 SE ranges overlap |
| Legal Research Bench | 38.94% ±3.39 | 40.87% ±3.42 | 1.92 pts | Reported ±1 SE ranges overlap |
| Tax Agent Bench | 32.12% ±3.37 | 37.89% ±3.45 | 5.77 pts | Reported ±1 SE ranges overlap |
| ProofBench v1.1 | 48.00% ±5.02 | 55.00% ±5.00 | 7.00 pts | Reported ±1 SE ranges overlap |
| Terminal-Bench-Science | 8.57% ±3.37 | 4.29% ±2.44 | 4.29 pts | Reported ±1 SE ranges overlap |
| IOI | 56.94% ±2.26 | 43.94% ±1.45 | 13.00 pts | Reported ±1 SE ranges do not overlap |
| ProgramBench | 1.00% ±0.70 | 0.50% ±0.50 | 0.50 pts | Reported ±1 SE ranges overlap |
| Terminal-Bench 4.0 | 19.70% ±2.31 | 10.61% ±1.75 | 9.09 pts | Reported ±1 SE ranges do not overlap |
| Vibe Code Bench v1.1 | 78.65% ±3.88 | 82.86% ±2.90 | 4.21 pts | Reported ±1 SE ranges overlap |
| CyberBench v1.1 | 43.75% ±2.21 | 69.41% ±5.76 | 25.66 pts | Reported ±1 SE ranges do not overlap |
| Access to Justice Benchmark | 67.06% ±0.76 | 72.18% ±0.72 | 5.12 pts | Reported ±1 SE ranges do not overlap |
| Financial Coaching Bench | 66.27% ±1.58 | 70.99% ±1.53 | 4.72 pts | Reported ±1 SE ranges do not overlap |
Performance by category
| Category | Gemini 3.8 Flash average | Muse Spark 1.3 average |
|---|---|---|
| Legal | 51.17% | 52.93% |
| Finance | 32.12% | 37.89% |
| Math | 48.00% | 55.00% |
| Science | 8.57% | 4.29% |
| Coding | 39.07% | 34.48% |
| Cyber | 43.75% | 69.41% |
| Social Mobility | 66.66% | 71.58% |
Cost and latency
Cost per test appears only where the benchmark reports it for both models. Latency is the measured completion time for that benchmark.
| Benchmark | Gemini 3.8 Flash cost | Muse Spark 1.3 cost | Gemini 3.8 Flash latency | Muse Spark 1.3 latency |
|---|---|---|---|---|
| Immigration | $0.17 | $0.05 | 56.53s | 79.86s |
| Legal Research Bench | $1.63 | $0.65 | 5m24s | 8m51s |
| Tax Agent Bench | $0.86 | $0.32 | 2m58s | 8m25s |
| ProofBench v1.1 | $0.60 | $0.43 | 6m09s | 8m54s |
| Terminal-Bench-Science | $5.64 | $4.41 | 55m11s | 1h08m |
| IOI | $3.98 | $2.36 | 14m20s | 29m51s |
| ProgramBench | $10.93 | $11.56 | 46m39s | 1h09m |
| Terminal-Bench 4.0 | $8.65 | $7.04 | 1h47m | 1h59m |
| Vibe Code Bench v1.1 | $6.87 | $2.10 | 8m39s | 12m54s |
| CyberBench v1.1 | $1.96 | $4.26 | 9m49s | 24m53s |
| Access to Justice Benchmark | $0.32 | $0.18 | 3m20s | 2m10s |
| Financial Coaching Bench | $0.10 | $0.07 | 115.20s | 3m12s |
Results available only for Gemini 3.8 Flash
- Vals Index
- Vals RSI Index
- Vals Finance Index
- Vals Legal Index
- Vals Science Index
- HLAB-Vals-1.1
- LegalBench
- EMB v1.1
- Finance Agent v2.1
- MortgageTax
- TaxEval v2
- MedCode
- MedScribe
- BioMysteryBench
- MysteryMechanism
- GPQA Diamond
- MMLU Pro
- MMMU Pro
- SAGE
- Code Migration v1.1
- LiveCodeBench
- SkillsBench
- SWE-bench
- SWE-bench Multimodal
- SRE Bench
- Public Benefits Bench v1.1
- CUA-bench
- Time Horizon Index: KSP
Results available only for Muse Spark 1.3
None.