GLM 4.5

We evaluated Z.ai’s GLM 4.5 model and found the following:

• GLM 4.5 delivers solid top-twenty results on AIME (#5/51), GPQA Diamond (#16/53), MMLU Pro (#15/51), LiveCodeBench (#15/53), and our own CaseLaw benchmark (#20/27).
• When compared directly to U.S. open-source peers, GLM 4.5 performs better than models such as Llama 4 Maverick, but is still outperformed by GPT OSS 120B across nearly every benchmark.

GLM 4.5 definitely still has room for improvement. We’re looking forward to seeing how open-source models continue to progress, but for now there is still a long way to go.