Accuracy (Average)

61.02%

Latency (Average)

12.75s

Avg. Cost (In/Out)

0.1 / 0.4

Context Window

1M

Max Output Tokens

66k

Input Modality

Hyperparameter settings
Default Provider : Google

Temperature

1

Top P

Default

Top K

Default

Max Output Tokens

65,535

Benchmarks

Accuracy

Rankings

0.0%

± 0.98
75/ 117

0.0%

± 1.91
64/ 68

0.0%

± 1.85
42/ 66

0.0%

± 0.99
61/ 81

0.0%

± 3.01
55/ 62

0.0%

± 0.92
93/ 123

0.0%

± 2.41
85/ 117

0.0%

± 1.17
74/ 123

0.0%

± 0.44
73/ 120

0.0%

± 0.40
81/ 116

0.0%

± 1.07
47/ 77
Contact us
Or send us an email at contact@vals.ai

License type:

Proprietary (contact us to get access)
Industry Partner
Academic

Read our methodology.