Mar 3, 2026
Gemini 3.1 Flash Lite evaluated across our benchmark suite
We evaluated Gemini 3.1 Flash Lite Preview across our full benchmark suite. The model is Googleโs fast and cost-efficient offering.
- The model does well on two of our multimodal benchmarks, SAGE (ranked 5th, with 49.5% accuracy) and Mortgage Tax (ranked 7th, 67.8% accuracy).
- It ranks 14th on MMLU Pro with 86.2% accuracy.
- On coding tasks the model still has room for improvementโit ranks 29th on both Live Code Bench and Terminal-Bench 2.0, and 28th on SWE-bench Verified. It scores 0% on Vibe Code Bench.
- Overall, it places 15th/20 on the Vals Multimodal Index and 22nd/31 on the Vals Index.
- The cost savings compared to other models in the Gemini 3 series or Gemini 2.5 are dramatic: roughly 5โ20x cheaper per test across benchmarks, while maintaining respectable accuracy. For example, on Finance Agent it costs
$0.072per test vs$0.370for Gemini 3 Flash, while performing comparably.
Our results show that the model does not perform as well as other models in the Gemini 3 series. However, it is fast and quite cost-efficient relative to those models, making it a good choice for applications that demand scale, speed, or cost-efficiency.
Evaluations were run with a temperature of 1.0 and a โhighโ thinking level, via the official Google API.