Claude Sonnet 4 (Thinking)

Release Date: 5/22/2025

Accuracy (Average)

58.52%

Latency (Average)

242.94s

Avg. Cost (In/Out)

3 / 15

Context Window

200k

Max Output Tokens

64k

Input Modality

Hyperparameter settings
Default Provider : Anthropic

Temperature

1

Top P

Default

Top K

Default

Max Output Tokens

64,000

Benchmarks

Accuracy

Rankings

0.0%

± 0.96
48/ 123

0.0%

± 1.94
50/ 73

0.0%

± 2.21
64/ 72

0.0%

± 0.98
74/ 87

0.0%

± 3.21
53/ 68

0.0%

± 0.88
58/ 129

0.0%

± 2.19
69/ 123

0.0%

± 1.14
43/ 58

0.0%

± 1.13
89/ 128

0.0%

± 0.46
56/ 126

0.0%

± 0.36
55/ 122

0.0%

± 1.04
47/ 83
Contact us
Or send us an email at contact@vals.ai

License type:

Proprietary (contact us to get access)
Industry Partner
Academic

Read our methodology.