DeepSeek V4 Flash 0731 vs Muse Spark Open: Benchmark Comparison
DeepSeek V4 Flash 0731 has the higher score on 2 of 4 shared benchmarks; Muse Spark Open leads on 2.
The largest observed score gap is 12.12 pts on Terminal-Bench 4.0 , where DeepSeek V4 Flash 0731 leads.
Reported ±1 standard-error ranges overlap on 2 of 4 shared benchmarks with comparable uncertainty data. This is not a pairwise statistical significance test.
Shared benchmark results
Scores and reported standard errors come from the latest visible Vals benchmark version available for both models.
| Benchmark | DeepSeek V4 Flash 0731 | Muse Spark Open | Gap | Reported uncertainty |
|---|---|---|---|---|
| Legal Research Bench | 30.29% ±3.19 | 38.46% ±3.38 | 8.17 pts | Reported ±1 SE ranges do not overlap |
| Tax Agent Bench | 28.07% ±3.16 | 26.32% ±2.65 | 1.75 pts | Reported ±1 SE ranges overlap |
| Terminal-Bench 4.0 | 18.69% ±3.54 | 6.57% ±0.51 | 12.12 pts | Reported ±1 SE ranges do not overlap |
| Vibe Code Bench v1.1 | 74.74% ±3.44 | 76.19% ±3.32 | 1.45 pts | Reported ±1 SE ranges overlap |
Performance by category
| Category | DeepSeek V4 Flash 0731 average | Muse Spark Open average |
|---|---|---|
| Legal | 30.29% | 38.46% |
| Finance | 28.07% | 26.32% |
| Coding | 46.71% | 41.38% |
Cost and latency
Cost per test appears only where the benchmark reports it for both models. Latency is the measured completion time for that benchmark.
| Benchmark | DeepSeek V4 Flash 0731 cost | Muse Spark Open cost | DeepSeek V4 Flash 0731 latency | Muse Spark Open latency |
|---|---|---|---|---|
| Legal Research Bench | $0.28 | $1.56 | 21m07s | 29m23s |
| Tax Agent Bench | $0.16 | $0.88 | 5m37s | 11m42s |
| Terminal-Bench 4.0 | $0.77 | $7.26 | 1h46m | 2h04m |
| Vibe Code Bench v1.1 | $0.91 | $1.66 | 37m22s | 31m09s |
Results available only for DeepSeek V4 Flash 0731
- LegalBench
- TaxEval v2
- MedCode
- MedScribe
- ProofBench v1.1
- BioMysteryBench
- Terminal-Bench-Science
- GPQA Diamond
- MMLU Pro
- IOI
- LiveCodeBench
- ProgramBench
- SkillsBench
- SWE-bench
- CyberBench v1.1
Results available only for Muse Spark Open
- Vals Finance Index
- Vals Index
- Vals Legal Index
- HLAB-Vals-1.1
- EMB v1.1
- Finance Agent v2.1
- Code Migration v1.1