Release Date: Sep 18, 2025

Developer MistralΒ πŸ‡«πŸ‡·
Context Window 128k
Max Output Tokens 128k
Token Costs (in/out) $2.00/5.00
Weights Private
Input Modalities

Accuracy

50.35 %

Avg. Cost (In/Out)

$ 2.00 / $ 5.00

Latency

6 min 37 s

Vals Index
BenchmarksAccuracyRankings

0.0%

Β±0.99
81/95

0.0%

Β±0.96
119/141

0.0%

Β±2.44
104/133

0.0%

Β±0.44
60/62

0.0%

Β±1.13
77/138

0.0%

Β±0.56
131/137

0.0%

Β±0.43
123/133

0.0%

Β±1.15
73/89
Proprietary BenchmarksAcademic BenchmarksIndustry Partners
Vals
Default Provider : Mistral
Temperature: 0.7
Top P: Default
Top K: Default
Max Output Tokens: 128,000

Updates

Sep 30, 2025

We evaluated Magistral Medium 1.2 (09/2025) and Magistral Small 1.2 (09/2025) - and found that both models perform decently for their size, especially on coding tasks. However, the models also struggled on many benchmarks.

  • Magistral Medium performs well on academic and coding benchmarks, placing in the top 20 on LiveCodeBench and AIME. However, the model struggles on our proprietary benchmarks, particularly MortgageTax and CaseLaw.
  • Surprisingly, Magistral Small tends to do better on finance and academic benchmarks, most notably outperforming Medium on MortgageTax (+8.8%). The model also does well on LiveCodeBench and AIME. However, Small struggled on our proprietary CorpFin and CaseLaw benchmarks, along with GPQA Diamond and MMLU Pro.
  • A large chunk of the performance loss was the result of models not outputting results in the format that was required.

The Medium model is priced at 2/2 / 5, and the Small at 0.5/0.5 / 1.5. The Small model has open weights, whereas the Medium model is only available via API.