Accuracy (Average)

60.77%

Latency (Average)

579.21s

Avg. Cost (In/Out)

15 / 75

Context Window

200k

Max Output Tokens

32k

Input Modality

Hyperparameter settings
Default Provider : Anthropic

Temperature

1

Top P

Default

Top K

Default

Max Output Tokens

32,000

Benchmarks

Accuracy

Rankings

0.0%

± 1.96
32/ 75

0.0%

± 2.02
62/ 74

0.0%

± 0.97
54/ 89

0.0%

± 3.02
57/ 70

0.0%

± 0.88
69/ 131

0.0%

± 2.30
83/ 125

0.0%

± 4.91
30/ 59

0.0%

± 1.11
88/ 130

0.0%

± 0.45
40/ 128

0.0%

± 0.33
26/ 124

0.0%

± 1.06
50/ 85
Contact us
Or send us an email at contact@vals.ai

License type:

Proprietary (contact us to get access)
Industry Partner
Academic

Read our methodology.