Jul 15, 2026
Thinking Machines' Inkling evaluated on the Vals Index
We evaluated Thinking Machines’ first open-weights model, Inkling, on the Vals Index.
-
Inkling scores 34.10% on the Vals Index, placing #30 of 43 models overall and #9 among open-weight models.
-
Its strongest component results include 75.49% on the SWE-bench Verified Vals Index subset and 69.23% on the CorpFin v2 Vals Index subset. It also scores 45.97% on the Finance Agent v2 Index subset.
-
Inkling scores 13.28% on the Vibe Code Bench Vals Index subset and 47.57% across three full trials of Terminal-Bench 2.1.
We used Thinking Machines’ recommended evaluation settings: temperature 1, top-p 1, up to 256k output tokens, separate reasoning enabled, and reasoning effort set to "0.99". Inkling supports a 256k context window, image inputs, and tool calling.
Congrats to the Thinking Machines team on the release!