Gemini 1.5 Pro (002)

Release Date: 9/24/2024

Accuracy (Average)

58.34%

Latency (Average)

13.97s

Avg. Cost (In/Out)

1.25 / 5

Context Window

2M

Max Output Tokens

8k

Input Modality

Hyperparameter settings
Default Provider : Google

Temperature

Default

Top P

Default

Top K

Default

Max Output Tokens

8,192

Benchmarks

Accuracy

Rankings

0.0%

± 0.97
107/ 116

0.0%

± 1.92
58/ 80

0.0%

± 0.96
109/ 122

0.0%

± 2.48
92/ 116

0.0%

± 1.09
108/ 122

0.0%

± 0.75
99/ 119

0.0%

± 0.42
89/ 115

0.0%

± 1.14
59/ 76
Contact us
Or send us an email at contact@vals.ai
Proprietary Benchmarks (contact us to get access)
Industry Partner Benchmarks
Academic Benchmarks

Read about our methodology.