New Finance Agent Benchmark Released

Released date

Model

Last Updated 5/7/2025

mistralai/mistral-medium-2505

Mistral Medium 3.1 (05/2025)

Mistral Medium 2505

Released Date: 5/7/2025

Avg. Accuracy:

61.9%

Latency:

23.15s

Performance by Benchmark

Benchmarks

Accuracy

Rankings

8.8%

( 27 / 33 )

8.8%

27 / 33

58.1%

( 24 / 44 )

58.1%

24 / 44

73.4%

( 31 / 60 )

73.4%

31 / 60

60.5%

( 28 / 35 )

60.5%

28 / 35

87.0%

( 28 / 54 )

87.0%

28 / 54

42.3%

( 25 / 50 )

42.3%

25 / 50

90.9%

( 25 / 53 )

90.9%

25 / 53

61.3%

( 63 / 75 )

61.3%

63 / 75

78.2%

( 39 / 56 )

78.2%

39 / 56

74.4%

( 30 / 50 )

74.4%

30 / 50

44.8%

( 33 / 51 )

44.8%

33 / 51

63.0%

( 23 / 32 )

63.0%

23 / 32

Academic Benchmarks

Proprietary Benchmarks (contact us to get access)

Cost Analysis

Input Cost

$0.40 / M Tokens

Output Cost

$2.00 / M Tokens

Input Cost (per char)

N/A

Output Cost (per char)

$0.40 / M chars

Join our mailing list to receive benchmark updates on

Stay up to date as new benchmarks and models are released.