Accuracy (Average)

78.42%

Latency (Average)

53.18s

Avg. Cost (In/Out)

0.3 / 0.5

Context Window

131k

Max Output Tokens

0

Input Modality

Hyperparameter settings
Default Provider : xAI

Temperature

0.7

Top P

0.95

Top K

Default

Max Output Tokens

0

Reasoning Effort

high

Benchmarks

Accuracy

Rankings

0.0%

± 0.96
29/ 97

0.0%

± 0.89
52/ 104

0.0%

± 0.53
38/ 96

0.0%

± 2.04
37/ 99

0.0%

± 1.08
41/ 103

0.0%

± 0.42
24/ 116

0.0%

± 0.27
49/ 95

0.0%

± 0.38
45/ 97
Contact us
Or send us an email at contact@vals.ai
Proprietary Benchmarks (contact us to get access)
Academic Benchmarks

Read about our methodology.