New Finance Agent Benchmark Released

Released date

Model

Last Updated 11/18/2024

mistralai/mistral-large-2411

Mistral Large (11/2024)

Latest version of the Mistral Large model.

Released Date: 11/18/2024

Avg. Accuracy:

58.3%

Latency:

10.36s

Performance by Benchmark

Benchmarks

Accuracy

Rankings

67.7%

( 40 / 60 )

67.7%

40 / 60

74.4%

( 40 / 54 )

74.4%

40 / 54

9.2%

( 45 / 50 )

9.2%

45 / 50

87.2%

( 40 / 53 )

87.2%

40 / 53

76.2%

( 42 / 56 )

76.2%

42 / 56

45.2%

( 41 / 52 )

45.2%

41 / 52

69.7%

( 35 / 50 )

69.7%

35 / 50

37.1%

( 42 / 52 )

37.1%

42 / 52

Academic Benchmarks

Proprietary Benchmarks (contact us to get access)

Cost Analysis

Input Cost

$2.00 / M Tokens

Output Cost

$6.00 / M Tokens

Input Cost (per char)

$0.64 / M chars

Output Cost (per char)

$2.08 / M chars

Join our mailing list to receive benchmark updates on

Stay up to date as new benchmarks and models are released.