Public

aeonfun / aeon

Benchmark updated: 9/23/202630 Tasks
Add models

The most autonomous AI agent framework: runs unattended on GitHub Actions, self-healing skills, drives Claude Code, Grok, Codex & more. No approval loops. Configure once, forget forever.

Languages

Shell40.3%TypeScript36.8%JavaScript13.6%Python6.1%Solidity2.3%CSS0.9%

Harness

1

Mini-SWE-agent
16 / 30

$0.35

4m12s

Key Takeaways

  • This 30-task result provides directional evidence for Claude Haiku 4.5 (Nonthinking) with Mini-SWE-agent on the aeon repository.
  • Average latency is 252.09 seconds per task.

Cost Analysis

Cost / Test vs. Accuracy
ACCURACYCOST

Average Token Use / Test

Token Usage
InputOutputReasoningCache readCache write
Claude Haiku 4.5 (Nonthinking)
1.8M

Cost is the clearest tradeoff in this comparison. Claude Haiku 4.5 (Nonthinking) leads at 53.33% for $0.35 per test. No other model in this comparison is cheaper.

Latency Analysis

Latency vs. Accuracy
ACCURACYLATENCY

Average Response Time / Test

Response Time
Claude Haiku 4.5 (Nonthinking)
4m 12s

Claude Haiku 4.5 (Nonthinking) is both the most accurate and fastest model in this comparison at 53.33% and 4m 12s.