GPT 4o (2024-11-20)

Release Date: 11/20/2024

Accuracy (Average)

61.51%

Latency (Average)

11.63s

Avg. Cost (In/Out)

2.5 / 10

Context Window

128k

Max Output Tokens

16k

Input Modality

Hyperparameter settings
Default Provider : OpenAI

Temperature

1

Top P

Default

Top K

Default

Max Output Tokens

16,384

Reasoning Effort

high

Benchmarks

Accuracy

Rankings

0.0%

± 0.97
108/ 125

0.0%

± 1.91
67/ 89

0.0%

± 0.86
28/ 131

0.0%

± 2.51
106/ 125

0.0%

± 1.12
111/ 130

0.0%

± 0.46
55/ 128

0.0%

± 0.44
103/ 124

0.0%

± 1.17
74/ 85
Contact us
Or send us an email at contact@vals.ai

License type:

Proprietary (contact us to get access)
Industry Partner
Academic

Read our methodology.