Accuracy (Vals Index)
52.77% ± 1.98
Latency (Vals Index)
543.29s
Cost/Test (Vals Index)
$2.06
Context Window
262k
Max Output Tokens
80k
Input Modality
Hyperparameter settings
Default Provider :
Mistral AI
Some benchmarks may use different provider and parameters. Please refer to the benchmark page for more information.
Temperature
0.7
Top P
0.95
Top K
Default
Max Output Tokens
80,000
Reasoning Effort
high
Show rankings only among open weight models
Benchmarks
Accuracy
Rankings
Contact us
Proprietary Benchmarks (contact us to get access)
Academic Benchmarks
Read about our methodology.