Compare Models

Select models (max 7)

SWE-1.6 FastMistral Large 4 OSS


Vals IndexGDP-weighted benchmark	N/A	56.42%±1.26
Legal Research BenchAgentic US legal research	N/A	35.58%±3.33
Finance Agent v2.1Core financial analyst tasks	N/A	61.72%±2.05
Tax Agent BenchAgentic US corporate tax research	N/A	27.33%±2.95
Terminal-Bench 4.0Frontier-difficulty terminal tasks	N/A	26.26%±5.13
Vibe Code Bench v1.1Building web apps from scratch	7.22%±2.63	81.56%±3.29

Benchmarks

Vals Index *

SWE-1.6 Fast

N/A

Mistral Large 4 OSS

0.00%± 1.26

(32/32)

Legal Research Bench *

SWE-1.6 Fast

N/A

Mistral Large 4 OSS

0.00%± 3.33

(89/89)

Finance Agent v2.1 *

SWE-1.6 Fast

N/A

Mistral Large 4 OSS

0.00%± 2.05

(35/35)

Tax Agent Bench *

SWE-1.6 Fast

N/A

Mistral Large 4 OSS

0.00%± 2.95

(80/80)

Terminal-Bench 4.0

SWE-1.6 Fast

N/A

Mistral Large 4 OSS

0.00%± 5.13

(59/59)

Vibe Code Bench v1.1 *

SWE-1.6 Fast

0.00%± 2.63

(123/123)

Mistral Large 4 OSS

0.00%± 3.29

(123/123)

Overall performance

Performance on the Vals Index, a GDP-weighted aggregation of tasks across finance, coding, and law

•2026-10-29

SWE-1.6 Fast Mistral Large 4 OSS

Comparison by Industry

Model performance on different sections of the economy.

Legal

N/A

vs.

25.70%

Finance

N/A

vs.

52.58%

Coding

7.22%

vs.

53.91%

Cost Analysis

Per task and per token model pricing.

Vals Index · USD

N/A

$3.717

Cost / TestVals Index

N/A

vs.

$3.717

Input Cost/ 1M Tokens

N/A

vs.

$0.70

Input Cache Read/ 1M Tokens

N/A

vs.

$0.07

Output Cost/ 1M Tokens

N/A

vs.

$2.10

Model Metadata

Basic information about each model.


Model provider	Devin	Mistral AI
Latency	N/A	2868.04s
Cost (In/Out)	N/A	$0.7 / $2.1
Context Window	N/A	1M
Max Output Token	N/A	256k
Input Modality