Gemini 1.5 Flash (002)

Release Date: 9/24/2024

Accuracy (Average)

49.76%

Latency (Average)

10.45s

Avg. Cost (In/Out)

0.075 / 0.3

Context Window

1M

Max Output Tokens

8k

Input Modality

Hyperparameter settings
Default Provider : Google

Temperature

Default

Top P

Default

Top K

Default

Max Output Tokens

8,192

Benchmarks

Accuracy

Rankings

0.0%

± 0.96
112/ 117

0.0%

± 1.83
72/ 81

0.0%

± 0.98
119/ 123

0.0%

± 2.50
108/ 117

0.0%

± 1.08
114/ 123

0.0%

± 0.74
108/ 120

0.0%

± 0.46
107/ 116

0.0%

± 1.19
71/ 77
Contact us
Or send us an email at contact@vals.ai

License type:

Proprietary (contact us to get access)
Industry Partner
Academic

Read our methodology.