New Finance Agent Benchmark Released

State of the art coding model from Anthropic.

Released Date: 8/5/2025

Avg. Accuracy:

69.7%

Latency:

467.00s

Performance by Benchmark

Benchmarks

Accuracy

Rankings

FinanceAgent

46.1%

( 4 / 39 )

CaseLaw

71.1%

( 14 / 35 )

TaxEval

75.9%

( 18 / 69 )

MortgageTax

65.2%

( 26 / 41 )

Math500

93.0%

( 13 / 54 )

AIME

44.2%

( 30 / 59 )

MGSM

94.2%

( 2 / 62 )

LegalBench

81.9%

( 9 / 84 )

MedQA

92.5%

( 13 / 65 )

GPQA

70.0%

( 24 / 61 )

MMLU Pro

87.8%

( 1 / 59 )

MMMU

74.0%

( 14 / 38 )

LiveCodeBench

64.6%

( 23 / 58 )

IOI

15.2%

( 5 / 18 )

Academic Benchmarks
Proprietary Benchmarks (contact us to get access)

Cost Analysis

Input Cost

$15.00 / M Tokens

Output Cost

$75.00 / M Tokens

Input Cost (per char)

N/A

Output Cost (per char)

$27.27 / M chars

Join our mailing list to receive benchmark updates on

Stay up to date as new benchmarks and models are released.