o1

Release Date: 12/17/2024

Accuracy (Average)

73.18%

Latency (Average)

35.56s

Avg. Cost (In/Out)

15 / 60

Context Window

200k

Max Output Tokens

100k

Input Modality

Hyperparameter settings
Default Provider : OpenAI

Temperature

Default

Top P

Default

Top K

Default

Max Output Tokens

100,000

Reasoning Effort

high

Benchmarks

Accuracy

Rankings

0.0%

± 0.86
23/ 121

0.0%

± 2.23
64/ 115

0.0%

± 1.39
95/ 121

0.0%

± 0.58
57/ 118

0.0%

± 0.36
50/ 114

0.0%

± 1.00
36/ 76
Contact us
Or send us an email at contact@vals.ai
Proprietary Benchmarks (contact us to get access)
Industry Partner Benchmarks
Academic Benchmarks

Read about our methodology.