Compare Models
Select models (max 7)
o1Mistral Large 4
| Vals IndexGDP-weighted benchmark | N/A | 56.53%±1.26 |
| Legal Research BenchAgentic US legal research | N/A | 35.58%±3.33 |
| Finance Agent v2.1Core financial analyst tasks | N/A | 61.72%±2.05 |
| Tax Agent BenchAgentic US corporate tax research | N/A | 30.67%±3.30 |
| Terminal-Bench 4.0Frontier-difficulty terminal tasks | N/A | 26.26%±5.13 |
| Vibe Code Bench v1.1Building web apps from scratch | N/A | 81.56%±3.29 |
Benchmarks
Vals Index *
o1
N/AMistral Large 4
0.00%± 1.26
(32/32)Legal Research Bench *
o1
N/AMistral Large 4
0.00%± 3.33
(89/89)Finance Agent v2.1 *
o1
N/AMistral Large 4
0.00%± 2.05
(35/35)Tax Agent Bench *
o1
N/AMistral Large 4
0.00%± 3.30
(80/80)Terminal-Bench 4.0
o1
N/AMistral Large 4
0.00%± 5.13
(59/59)Vibe Code Bench v1.1 *
o1
N/AMistral Large 4
0.00%± 3.29
(123/123)Overall performance
Performance on the Vals Index, a GDP-weighted aggregation of tasks across finance, coding, and law
Comparison by Industry
Model performance on different sections of the economy.
Legal
80.39%
vs.25.70%
Finance
74.28%
vs.53.69%
Academic
78.04%
vs.N/A
Coding
50.26%
vs.53.91%
Cost Analysis
Per task and per token model pricing.
Vals Index · USD
N/A
$3.717
Cost / TestVals Index
N/A
vs.$3.717
Input Cost/ 1M Tokens
$15.00
vs.$0.70
Input Cache Read/ 1M Tokens
$7.50
vs.$0.07
Output Cost/ 1M Tokens
$60.00
vs.$2.10
Model Metadata
Basic information about each model.
| Model provider | ||
| Latency | N/A | 2868.04s |
| Cost (In/Out) | $15 / $60 | $0.7 / $2.1 |
| Context Window | 200k | 1M |
| Max Output Token | 100k | 256k |
| Input Modality |