New Finance Agent Benchmark Released

Released date

Model

Last Updated 3/17/2025

mistralai/mistral-small-2503

Mistral Small 3.1 (03/2025)

Mistral Small 2503

Released Date: 3/17/2025

Avg. Accuracy:

57.8%

Latency:

9.24s

Performance by Benchmark

Benchmarks

Accuracy

Rankings

10.0%

( 17 / 22 )

10.0%

17 / 22

53.2%

( 22 / 35 )

53.2%

22 / 35

76.7%

( 31 / 55 )

76.7%

31 / 55

65.9%

( 36 / 62 )

65.9%

36 / 62

62.9%

( 34 / 42 )

62.9%

34 / 42

75.0%

( 10 / 23 )

75.0%

10 / 23

68.4%

( 33 / 38 )

68.4%

33 / 38

3.5%

( 31 / 34 )

3.5%

31 / 34

85.4%

( 30 / 36 )

85.4%

30 / 36

70.9%

( 39 / 60 )

70.9%

39 / 60

69.1%

( 28 / 40 )

69.1%

28 / 40

41.4%

( 28 / 35 )

41.4%

28 / 35

66.0%

( 26 / 35 )

66.0%

26 / 35

60.6%

( 17 / 22 )

60.6%

17 / 22

Academic Benchmarks

Proprietary Benchmarks (contact us to get access)

Cost Analysis

Input Cost

$0.07 / M Tokens

Output Cost

$0.30 / M Tokens

Input Cost (per char)

$0.03 / M chars

Output Cost (per char)

$0.07 / M chars

Join our mailing list to receive benchmark updates on

Stay up to date as new benchmarks and models are released.