New Finance Agent Benchmark Released

Released Date: 4/14/2025

Avg. Accuracy:

67.2%

Latency:

27.62s

Performance by Benchmark

Benchmarks

Accuracy

Rankings

FinanceAgent

20.8%

( 18 / 34 )

CorpFin

65.8%

( 14 / 45 )

CaseLaw

74.6%

( 6 / 28 )

TaxEval

75.0%

( 24 / 62 )

MortgageTax

77.7%

( 7 / 35 )

Math500

88.0%

( 26 / 54 )

AIME

49.4%

( 24 / 52 )

MGSM

87.8%

( 40 / 55 )

LegalBench

76.8%

( 41 / 77 )

MedQA

84.6%

( 32 / 58 )

GPQA

67.4%

( 24 / 54 )

MMLU Pro

77.2%

( 29 / 52 )

MMMU

70.5%

( 18 / 32 )

LiveCodeBench

58.2%

( 27 / 54 )

SWE-bench

34.8%

( 11 / 16 )

Academic Benchmarks
Proprietary Benchmarks (contact us to get access)

Cost Analysis

Input Cost

$0.40 / M Tokens

Output Cost

$1.60 / M Tokens

Input Cost (per char)

N/A

Output Cost (per char)

$0.49 / M chars

Join our mailing list to receive benchmark updates on

Stay up to date as new benchmarks and models are released.