Compare Models
Select models (max 5)
Claude Sonnet 5Grok 4.7
| Vals IndexGDP-weighted benchmark | 51.77%±1.09 | 54.95%±1.07 |
| Legal Research BenchAgentic US legal research | 41.83%±3.43 | 47.12%±3.47 |
| Finance Agent (v2)Core financial analyst tasks | 53.91%±0.52 | 52.25%±0.35 |
| Tax Agent BenchAgentic US corporate tax research | 62.27%±3.19 | 65.60%±3.24 |
| MedCodeMedical billing code support | 47.54%±2.27 | 49.55%±2.17 |
| Terminal-Bench ScienceExpert-authored scientific research workflows | 2.86%±2.01 | 10.00%±3.61 |
| Code MigrationRewriting programs in new languages | 44.39%±4.25 | 44.82%±4.21 |
| Terminal-Bench 4.0Frontier-difficulty terminal tasks | 9.60%±1.01 | 28.79%±2.31 |
| Vibe Code Bench v1.1Building web apps from scratch | 81.33%±3.05 | 86.17%±2.18 |
Benchmarks
Vals Index *
Claude Sonnet 5
0.00%± 1.09
(30/30)Grok 4.7
0.00%± 1.07
(30/30)Legal Research Bench *
Claude Sonnet 5
0.00%± 3.43
(71/71)Grok 4.7
0.00%± 3.47
(71/71)Finance Agent (v2) *
Claude Sonnet 5
0.00%± 0.52
(72/72)Grok 4.7
0.00%± 0.35
(72/72)Tax Agent Bench *
Claude Sonnet 5
0.00%± 3.19
(63/63)Grok 4.7
0.00%± 3.24
(63/63)MedCode *
Claude Sonnet 5
0.00%± 2.27
(103/103)Grok 4.7
0.00%± 2.17
(103/103)Terminal-Bench Science
Claude Sonnet 5
0.00%± 2.01
(33/33)Grok 4.7
0.00%± 3.61
(33/33)Code Migration *
Claude Sonnet 5
0.00%± 4.25
(70/70)Grok 4.7
0.00%± 4.21
(70/70)Terminal-Bench 4.0
Claude Sonnet 5
0.00%± 1.01
(31/31)Grok 4.7
0.00%± 2.31
(31/31)Vibe Code Bench v1.1 *
Claude Sonnet 5
0.00%± 3.05
(105/105)Grok 4.7
0.00%± 2.18
(105/105)Overall performance
Performance on the Vals Index, a GDP-weighted aggregation of tasks across finance, coding, and law
Comparison by Industry
Model performance on different sections of the economy.
Legal
43.58%
vs.48.00%
Finance
65.63%
vs.61.61%
Healthcare
61.80%
vs.69.47%
Math
77.00%
vs.26.00%
Science
2.86%
vs.34.83%
Academic
86.48%
vs.N/A
Education
48.92%
vs.40.79%
Coding
44.74%
vs.43.60%
Beta
61.91%
vs.69.46%
Social Mobility
66.03%
vs.65.63%
Cost Analysis
Per task and per token model pricing.
Vals Index · USD
$13.72
$12.12
Cost / TestVals Index
$13.72
vs.$12.12
Input Cost/ 1M Tokens
$2.00
vs.$2.00
Input Cache Write/ 1M Tokens
$2.50
vs.N/A
Input Cache Read/ 1M Tokens
$0.20
vs.$0.50
Output Cost/ 1M Tokens
$10.00
vs.$6.00
Model Metadata
Basic information about each model.
| Model provider | ||
| Latency | 3255.62s | 2131.40s |
| Cost (In/Out) | $2 / $10 | $2 / $6 |
| Context Window | 1M | 500k |
| Max Output Token | 128k | 500k |
| Input Modality |