DeepSeek V4.1 Flash 1017 vs Grok 4.7: Benchmark Comparison

DeepSeek V4.1 Flash 1017 has the higher score on 5 of 9 shared benchmarks; Grok 4.7 leads on 4.

The largest observed score gap is 10.15 pts on Tax Agent Bench , where DeepSeek V4.1 Flash 1017 leads.

Reported ±1 standard-error ranges overlap on 7 of 9 shared benchmarks with comparable uncertainty data. This is not a pairwise statistical significance test.

Open interactive comparison Read the methodology

Shared benchmark results

Scores and reported standard errors come from the latest visible Vals benchmark version available for both models.

Benchmark DeepSeek V4.1 Flash 1017 Grok 4.7 Gap Reported uncertainty
Vals Index 56.58% ±1.27 54.95% ±1.07 1.64 pts Reported ±1 SE ranges overlap
Harvey's Legal Agent Benchmark 9.17% ±2.51 12.50% ±2.66 3.33 pts Reported ±1 SE ranges overlap
Legal Research Bench 45.19% ±3.46 47.12% ±3.47 1.92 pts Reported ±1 SE ranges overlap
EMB 61.80% ±3.19 66.99% ±3.04 5.19 pts Reported ±1 SE ranges overlap
Finance Agent (v2) 56.96% ±2.05 52.25% ±0.35 4.71 pts Reported ±1 SE ranges do not overlap
Tax Agent Bench 44.35% ±3.57 34.20% ±3.42 10.15 pts Reported ±1 SE ranges do not overlap
Code Migration 44.21% ±4.46 44.82% ±4.21 0.61 pts Reported ±1 SE ranges overlap
Terminal-Bench 4.0 31.82% ±2.62 28.79% ±2.31 3.03 pts Reported ±1 SE ranges overlap
Vibe Code Bench v1.1 87.73% ±2.75 86.17% ±2.18 1.56 pts Reported ±1 SE ranges overlap

Performance by category

Category DeepSeek V4.1 Flash 1017 average Grok 4.7 average
Legal 27.18% 29.81%
Finance 54.37% 51.15%
Coding 54.59% 53.26%

Cost and latency

Cost per test appears only where the benchmark reports it for both models. Latency is the measured completion time for that benchmark.

Benchmark DeepSeek V4.1 Flash 1017 cost Grok 4.7 cost DeepSeek V4.1 Flash 1017 latency Grok 4.7 latency
Vals Index $0.64 $12.11 36m33s 35m30s
Harvey's Legal Agent Benchmark $0.54 $11.13 21m39s 42m05s
Legal Research Bench $0.70 $4.92 35m07s 21m14s
EMB $0.36 $6.48 16m47s 34m57s
Finance Agent (v2) $0.46 $2.72 14m39s 15m33s
Tax Agent Bench $0.46 $1.80 21m04s 16m36s
Code Migration $1.86 $36.55 2h11m 1h09m
Terminal-Bench 4.0 $0.54 $18.01 41m10s 50m08s
Vibe Code Bench v1.1 $0.58 $15.83 16m14s 35m47s

Results available only for DeepSeek V4.1 Flash 1017

None.

Results available only for Grok 4.7

  • Vals RSI Index
  • Vals Science Index
  • LegalBench
  • MedCode
  • MedScribe
  • ProofBench v1.1
  • BioMysteryBench
  • MysteryMechanism
  • Robo-bench
  • Terminal-Bench-Science
  • SAGE
  • IOI
  • ProgramBench
  • SWE-bench Multimodal
  • CyberBench v1.1
  • SRE Bench
  • Public Benefits Bench v1.1
Model details DeepSeek V4.1 Flash 1017 Model details Grok 4.7