Muse Spark 1.3 Max vs GPT-6.1 Sol: Benchmark Comparison
Muse Spark 1.3 Max has the higher score on 3 of 13 shared benchmarks; GPT-6.1 Sol leads on 10.
The largest observed score gap is 46.95 pts on SRE Bench , where GPT-6.1 Sol leads.
Reported ±1 standard-error ranges overlap on 3 of 12 shared benchmarks with comparable uncertainty data. This is not a pairwise statistical significance test.
Shared benchmark results
Scores and reported standard errors come from the latest visible Vals benchmark version available for both models.
| Benchmark | Muse Spark 1.3 Max | GPT-6.1 Sol | Gap | Reported uncertainty |
|---|---|---|---|---|
| Vals RSI Index | 19.64% | 26.62% | 6.98 pts | Uncertainty comparison unavailable |
| Legal Research Bench | 55.29% ±3.46 | 38.46% ±3.38 | 16.83 pts | Reported ±1 SE ranges do not overlap |
| Tax Agent Bench | 42.44% ±3.51 | 21.75% ±2.98 | 20.68 pts | Reported ±1 SE ranges do not overlap |
| ProofBench v1.1 | 58.00% ±4.96 | 99.00% ±1.00 | 41.00 pts | Reported ±1 SE ranges do not overlap |
| MysteryMechanism | 36.04% ±3.23 | 46.40% ±3.35 | 10.36 pts | Reported ±1 SE ranges do not overlap |
| Terminal-Bench-Science | 10.00% ±3.61 | 52.86% ±6.01 | 42.86 pts | Reported ±1 SE ranges do not overlap |
| IOI | 56.56% ±2.52 | 96.89% ±3.11 | 40.33 pts | Reported ±1 SE ranges do not overlap |
| ProgramBench | 2.50% ±1.11 | 3.00% ±1.21 | 0.50 pts | Reported ±1 SE ranges overlap |
| SWE-bench Multimodal | 43.13% ±2.26 | 43.54% ±2.27 | 0.42 pts | Reported ±1 SE ranges overlap |
| Terminal-Bench 4.0 | 24.75% ±0.51 | 55.05% ±1.82 | 30.30 pts | Reported ±1 SE ranges do not overlap |
| Vibe Code Bench v1.1 | 85.86% ±2.51 | 88.93% ±1.89 | 3.08 pts | Reported ±1 SE ranges overlap |
| CyberBench v1.1 | 72.74% ±5.67 | 39.29% ±2.74 | 33.45 pts | Reported ±1 SE ranges do not overlap |
| SRE Bench | 3.82% ±1.19 | 50.76% ±3.10 | 46.95 pts | Reported ±1 SE ranges do not overlap |
Performance by category
| Category | Muse Spark 1.3 Max average | GPT-6.1 Sol average |
|---|---|---|
| Legal | 55.29% | 38.46% |
| Finance | 42.44% | 21.75% |
| Math | 58.00% | 99.00% |
| Science | 23.02% | 49.63% |
| Coding | 42.56% | 57.48% |
| Cyber | 38.28% | 45.02% |
Cost and latency
Cost per test appears only where the benchmark reports it for both models. Latency is the measured completion time for that benchmark.
| Benchmark | Muse Spark 1.3 Max cost | GPT-6.1 Sol cost | Muse Spark 1.3 Max latency | GPT-6.1 Sol latency |
|---|---|---|---|---|
| Vals RSI Index | $48.82 | $98.21 | 90h00m | 90h00m |
| Legal Research Bench | $0.59 | $3.38 | 5m17s | 34m20s |
| Tax Agent Bench | $0.39 | $1.32 | 4m09s | 20m14s |
| ProofBench v1.1 | $0.48 | $0.23 | 9m29s | 4m45s |
| MysteryMechanism | $0.85 | $0.28 | 7m32s | 7m17s |
| Terminal-Bench-Science | $6.09 | $3.44 | 1h24m | 1h23m |
| IOI | $1.73 | $1.26 | 28m58s | 31m31s |
| ProgramBench | $54.29 | $2.87 | 5h28m | 1h10m |
| SWE-bench Multimodal | $0.86 | $0.35 | 10m52s | 6m56s |
| Terminal-Bench 4.0 | $6.65 | $1.72 | 52m56s | 45m12s |
| Vibe Code Bench v1.1 | $2.54 | $6.23 | 16m18s | 1h15m |
| CyberBench v1.1 | $3.34 | $0.29 | 16m18s | 3m42s |
| SRE Bench | $25.86 | $2.69 | 1h47m | 32m32s |
Results available only for Muse Spark 1.3 Max
- Vibe Code Bench 1-100
- CUA-bench
Results available only for GPT-6.1 Sol
- Vals Finance Index
- Vals Index
- Vals Science Index
- HLAB-Vals-1.1
- ClaimBench
- EMB v1.1
- Finance Agent v2.1
- MedCode
- MedScribe
- BioMysteryBench
- Robo-bench
- SAGE
- Code Migration v1.1
- Public Benefits Bench v1.1