DeepSeek V3 (03/24/2025)

Release Date: 3/24/2025

Accuracy (Average)

58.83%

Latency (Average)

46.48s

Avg. Cost (In/Out)

0.9 / 0.9

Context Window

131k

Max Output Tokens

131k

Input Modality

Hyperparameter settings
Default Provider : DeepSeek

Temperature

1

Top P

Default

Top K

Default

Max Output Tokens

131,072

Show rankings only among open weight models

Benchmarks

Accuracy

Rankings

0.0%

± 0.98
77/ 117

0.0%

± 0.88
67/ 123

0.0%

± 2.45
90/ 117

0.0%

± 0.90
51/ 55

0.0%

± 1.16
80/ 123

0.0%

± 0.42
81/ 120

0.0%

± 0.40
73/ 116
Contact us
Or send us an email at contact@vals.ai

License type:

Proprietary (contact us to get access)
Industry Partner
Academic

Read our methodology.