New Finance Agent Benchmark Released

Released date

Model

Last Updated 8/7/2025

openai/nectarine-nano-alpha-2025-08-04

Released Date: 8/7/2025

Avg. Accuracy:

73.7%

Latency:

55.67s

Performance by Benchmark

Benchmarks

Accuracy

Rankings

74.6%

( 48 / 69 )

74.6%

48 / 69

72.8%

( 29 / 56 )

72.8%

29 / 56

64.9%

( 25 / 33 )

64.9%

25 / 33

93.8%

( 11 / 52 )

93.8%

11 / 52

83.3%

( 10 / 46 )

83.3%

10 / 46

89.3%

( 30 / 49 )

89.3%

30 / 49

49.4%

( 68 / 72 )

49.4%

68 / 72

59.6%

( 25 / 48 )

59.6%

25 / 48

77.9%

( 22 / 46 )

77.9%

22 / 46

70.9%

( 15 / 30 )

70.9%

15 / 30

Academic Benchmarks

Proprietary Benchmarks (contact us to get access)

Cost Analysis

Input Cost

$0.05 / M Tokens

Output Cost

$0.40 / M Tokens

Input Cost (per char)

$0.01 / M chars

Output Cost (per char)

N/A

Join our mailing list to receive benchmark updates on

Stay up to date as new benchmarks and models are released.