We continue to find strong results for GLM 5 across the remainder of our benchmarks, often exceeding the performance of the previous open-weight champion, Kimi K2.5. Here are our key takeaways:

• The model excels on our IOI benchmark, beating Kimi by almost 5% (but taking almost twice as long to run)
• The model struggles on our private CaseLaw and TaxEval benchmarks, placing 50th and 48th, respectively

See our twitter post for the hyperparameters we used for evaluation. Congrats again to the team at z.AI on the release!

We found the newest release from z.AI to represent a step up for open-source models, especially on Terminal-Bench 2.0, on which the model places seventh overall and beats Kimi K2.5 for top open-weight model by a huge margin (9%).

The model surpasses Kimi as leading the open-weight category in several other benchmarks as well, most notably on Finance Agent, on which it breaks 50% and places 11th overall.

The biggest story here is price - the model is several times cheaper than leading closed-source models from OpenAI and Anthropic. However, Kimi K2.5 is 2.5x cheaper still on our Vals Index, on which it places first due to superior performance on CorpFin.

We evaluated the model with the following parameters:

• temperature 0.7 and low max output tokens on agentic coding benchmarks (16K on SWE-bench Verified and 8K on Terminal-Bench 2.0)
• 65K max output tokens on CaseLaw and CorpFin
• temperature 1 and 130K max output tokens otherwise