Compare Models
Select models (max 7)
Qwen 3.8 27BMiniMax-M3.1-Flash
| Vals IndexGDP-weighted benchmark | N/A | 53.78%±1.07 |
| Legal Research BenchAgentic US legal research | 36.06%±3.34 | 34.13%±3.30 |
| Finance Agent v2.1Core financial analyst tasks | N/A | 58.83%±2.07 |
| Tax Agent BenchAgentic US corporate tax research | 30.89%±3.32 | 32.14%±3.34 |
| MedCodeMedical billing code support | 28.70%±1.97 | N/A |
| Terminal-Bench-ScienceExpert-authored scientific research workflows | 0.00%±0.00 | N/A |
| Terminal-Bench 4.0Frontier-difficulty terminal tasks | N/A | 25.25%±1.01 |
| Vibe Code Bench v1.1Building web apps from scratch | 64.85%±4.83 | 73.94%±4.25 |
Benchmarks
Vals Index *
Qwen 3.8 27B
N/AMiniMax-M3.1-Flash
0.00%± 1.07
(26/26)Legal Research Bench *
Qwen 3.8 27B
0.00%± 3.34
(84/84)MiniMax-M3.1-Flash
0.00%± 3.30
(84/84)Finance Agent v2.1 *
Qwen 3.8 27B
N/AMiniMax-M3.1-Flash
0.00%± 2.07
(30/30)Tax Agent Bench *
Qwen 3.8 27B
0.00%± 3.32
(75/75)MiniMax-M3.1-Flash
0.00%± 3.34
(75/75)MedCode *
Qwen 3.8 27B
0.00%± 1.97
(107/107)MiniMax-M3.1-Flash
N/ATerminal-Bench-Science
Qwen 3.8 27B
0.00%± 0.00
(42/42)MiniMax-M3.1-Flash
N/ATerminal-Bench 4.0
Qwen 3.8 27B
N/AMiniMax-M3.1-Flash
0.00%± 1.01
(54/54)Vibe Code Bench v1.1 *
Qwen 3.8 27B
0.00%± 4.83
(118/118)MiniMax-M3.1-Flash
0.00%± 4.25
(118/118)Overall performance
Performance on the Vals Index, a GDP-weighted aggregation of tasks across finance, coding, and law
Comparison by Industry
Model performance on different sections of the economy.
Legal
59.24%
vs.20.82%
Finance
55.56%
vs.52.94%
Healthcare
56.27%
vs.N/A
Math
16.00%
vs.N/A
Science
0.00%
vs.N/A
Academic
85.72%
vs.N/A
Education
52.40%
vs.N/A
Coding
52.00%
vs.49.60%
Cyber
67.80%
vs.N/A
Cost Analysis
Per task and per token model pricing.
Vals Index · USD
N/A
$0.66
Cost / TestVals Index
N/A
vs.$0.66
Input Cost/ 1M Tokens
$0.50
vs.$0.15
Input Cache Write/ 1M Tokens
$0.625
vs.N/A
Input Cache Read/ 1M Tokens
$0.05
vs.$0.015
Output Cost/ 1M Tokens
$3.00
vs.$0.60
Model Metadata
Basic information about each model.
| Model provider | ||
| Latency | N/A | 2597.84s |
| Cost (In/Out) | $0.5 / $3 | $0.15 / $0.6 |
| Context Window | 262k | 1M |
| Max Output Token | 66k | 524k |
| Input Modality |