Accuracy (Average)

54.69%

Latency (Average)

21.59s

Avg. Cost (In/Out)

3 / 15

Context Window

1M

Max Output Tokens

64k

Input Modality

Hyperparameter settings
Default Provider : Anthropic

Temperature

1

Top P

Default

Top K

Default

Max Output Tokens

64,000

Benchmarks

Accuracy

Rankings

0.0%

± 0.96
53/ 121

0.0%

± 2.00
33/ 72

0.0%

± 1.93
14/ 70

0.0%

± 3.14
49/ 66
Contact us
Or send us an email at contact@vals.ai

License type:

Proprietary (contact us to get access)
Industry Partner
Academic

Read our methodology.