Mar 17, 2026
GPT 5.4 Mini Evaluated!
We evaluated GPT 5.4 Mini across our benchmarks.
- It had quite strong performance for its cost, coming in at #13 on the Vals Index (equivalent to GPT 5).
- Its performance on Vibe Code Bench was especially impressive, coming in at #7, and beating out both Gemini 3 Flash (12/25) and Claude Haiku 4.5 (Thinking).
- GPT 5.4 Mini also had a strong performance on other coding benchmarks, ranking #11 on SWE-bench Verified and #18 on Terminal-Bench 2.0, again beating out GPT 5.
All evaluations were run using the official OpenAI API using “xhigh” reasoning, except on Terminal-Bench 2.0, where we used “high”. The numbers on the Vals Index are finalized, but on certain benchmarks, we are still confirming results based on the latest parameters.