Gemini 1.5 Pro (002)

Release Date: 9/24/2024

Accuracy (Average)

58.34%

Latency (Average)

13.97s

Avg. Cost (In/Out)

1.25 / 5

Context Window

2M

Max Output Tokens

8k

Input Modality

Hyperparameter settings
Default Provider : Google

Temperature

Default

Top P

Default

Top K

Default

Max Output Tokens

8,192

Benchmarks

Accuracy

Rankings

0.0%

± 0.97
121/ 130

0.0%

± 1.92
70/ 91

0.0%

± 0.96
122/ 135

0.0%

± 2.48
105/ 129

0.0%

± 1.09
120/ 134

0.0%

± 0.75
113/ 132

0.0%

± 0.42
102/ 128

0.0%

± 1.14
68/ 86
Contact us
Or send us an email at contact@vals.ai

License type:

Proprietary (contact us to get access)
Industry Partner
Academic

Read our methodology.