GPT 4o Mini

Release Date: 7/18/2024

Accuracy (Average)

50.06%

Latency (Average)

12.54s

Avg. Cost (In/Out)

0.15 / 0.6

Context Window

128k

Max Output Tokens

16k

Input Modality

Hyperparameter settings
Default Provider : OpenAI

Temperature

1

Top P

Default

Top K

Default

Max Output Tokens

16,384

Reasoning Effort

high

Benchmarks

Accuracy

Rankings

0.0%

± 0.98
100/ 116

0.0%

± 1.93
61/ 80

0.0%

± 0.96
105/ 122

0.0%

± 2.50
109/ 116

0.0%

± 1.13
118/ 122

0.0%

± 0.46
111/ 115

0.0%

± 1.19
71/ 76
Contact us
Or send us an email at contact@vals.ai

License type:

Proprietary (contact us to get access)
Industry Partner
Academic

Read our methodology.