Accuracy (Average)

42.17%

Latency (Average)

108.83s

Avg. Cost (In/Out)

0.3 / 2.5

Context Window

1M

Max Output Tokens

66k

Input Modality

Hyperparameter settings
Default Provider : Google

Temperature

1

Top P

Default

Top K

Default

Max Output Tokens

65,536

Benchmarks

Accuracy

Rankings

0.0%

± 1.92
42/ 72

0.0%

± 1.91
23/ 70

0.0%

± 3.42
26/ 66

0.0%

± 1.03
51/ 58
Contact us
Or send us an email at contact@vals.ai

License type:

Proprietary (contact us to get access)
Industry Partner
Academic

Read our methodology.