Qwen 3.8 Max vs Muse Spark Open: Benchmark Comparison
Qwen 3.8 Max has the higher score on 4 of 5 shared benchmarks; Muse Spark Open leads on 1.
The largest observed score gap is 27.78 pts on Terminal-Bench 4.0 , where Qwen 3.8 Max leads.
Reported ±1 standard-error ranges overlap on 2 of 5 shared benchmarks with comparable uncertainty data. This is not a pairwise statistical significance test.
Shared benchmark results
Scores and reported standard errors come from the latest visible Vals benchmark version available for both models.
| Benchmark | Qwen 3.8 Max | Muse Spark Open | Gap | Reported uncertainty |
|---|---|---|---|---|
| Legal Research Bench | 47.60% ±3.47 | 38.46% ±3.38 | 9.13 pts | Reported ±1 SE ranges do not overlap |
| EMB v1.1 | 65.99% ±2.69 | 61.98% ±2.70 | 4.00 pts | Reported ±1 SE ranges overlap |
| Tax Agent Bench | 32.09% ±3.37 | 26.32% ±2.65 | 5.77 pts | Reported ±1 SE ranges overlap |
| Terminal-Bench 4.0 | 34.34% ±3.94 | 6.57% ±0.51 | 27.78 pts | Reported ±1 SE ranges do not overlap |
| Vibe Code Bench v1.1 | 64.70% ±5.36 | 76.19% ±3.32 | 11.49 pts | Reported ±1 SE ranges do not overlap |
Performance by category
| Category | Qwen 3.8 Max average | Muse Spark Open average |
|---|---|---|
| Legal | 47.60% | 38.46% |
| Finance | 49.04% | 44.15% |
| Coding | 49.52% | 41.38% |
Cost and latency
Cost per test appears only where the benchmark reports it for both models. Latency is the measured completion time for that benchmark.
| Benchmark | Qwen 3.8 Max cost | Muse Spark Open cost | Qwen 3.8 Max latency | Muse Spark Open latency |
|---|---|---|---|---|
| Legal Research Bench | $2.49 | $1.56 | 1h01m | 29m23s |
| EMB v1.1 | $2.66 | $5.35 | 57m47s | 1h25m |
| Tax Agent Bench | $1.55 | $0.88 | 40m36s | 11m42s |
| Terminal-Bench 4.0 | $10.63 | $7.26 | 2h28m | 2h04m |
| Vibe Code Bench v1.1 | $8.24 | $1.66 | 2h49m | 31m09s |
Results available only for Qwen 3.8 Max
- Vals RSI Index
- LegalBench
- MortgageTax
- TaxEval v2
- MedCode
- MedScribe
- ProofBench v1.1
- MysteryMechanism
- Terminal-Bench-Science
- GPQA Diamond
- MMLU Pro
- MMMU Pro
- SAGE
- IOI
- LiveCodeBench
- ProgramBench
- SkillsBench
- SWE-bench
- SWE-bench Multimodal
- Vibe Code Bench 1-100
- CyberBench v1.1
- Public Benefits Bench v1.1
Results available only for Muse Spark Open
- Vals Finance Index
- Vals Index
- Vals Legal Index
- HLAB-Vals-1.1
- Finance Agent v2.1
- Code Migration v1.1