Accuracy (Vals Index)
49.28% ± 1.29
Latency (Vals Index)
1247.29s
Avg. Cost (In/Out)
3.74 / 9.36
Context Window
256k
Max Output Tokens
256k
Input Modality
Hyperparameter settings
Default Provider :
Thinkingmachines
Some benchmarks may use different provider and parameters. Please refer to the benchmark page for more information.
Temperature
1
Top P
1
Top K
Default
Max Output Tokens
256,000
Reasoning Effort
0.99
Show rankings only among open weight models
Contact us
Read our methodology.