New Finance Agent Benchmark Released

Released date

Model

Last Updated 3/17/2025

mistralai/mistral-small-2503

Mistral Small 3.1 (03/2025)

Mistral Small 2503

Released Date: 3/17/2025

Avg. Accuracy:

53.6%

Latency:

9.92s

Performance by Benchmark

Benchmarks

Accuracy

Rankings

10.0%

( 26 / 33 )

10.0%

26 / 33

53.2%

( 31 / 44 )

53.2%

31 / 44

62.9%

( 52 / 60 )

62.9%

52 / 60

75.0%

( 12 / 35 )

75.0%

12 / 35

68.4%

( 49 / 54 )

68.4%

49 / 54

3.5%

( 47 / 50 )

3.5%

47 / 50

84.2%

( 47 / 53 )

84.2%

47 / 53

70.9%

( 52 / 75 )

70.9%

52 / 75

69.1%

( 44 / 56 )

69.1%

44 / 56

41.4%

( 44 / 52 )

41.4%

44 / 52

66.0%

( 41 / 50 )

66.0%

41 / 50

60.0%

( 25 / 32 )

60.0%

25 / 32

31.8%

( 47 / 52 )

31.8%

47 / 52

Academic Benchmarks

Proprietary Benchmarks (contact us to get access)

Cost Analysis

Input Cost

$0.07 / M Tokens

Output Cost

$0.30 / M Tokens

Input Cost (per char)

N/A

Output Cost (per char)

$0.08 / M chars

Join our mailing list to receive benchmark updates on

Stay up to date as new benchmarks and models are released.