Public
abhishek203 / SfAgent
Benchmark updated: 8/17/202630 Tasks
🙌 OpenHands: Code Less, Make More
Languages
TypeScript94.2%JavaScript4.7%Python0.3%CSS0.3%Shell0.2%HTML0.1%Other0.1%
Harness | Input / Output Cost | ||||||
|---|---|---|---|---|---|---|---|
1 |  Mini-SWE-agent | 24 / 30 | $0.23 | N/A | 57.08s | ||
2 | Mini-SWE-agent | 21 / 30 | $0.18 | $1/$5 | 2m01s |
Key Takeaways
- Claude Opus 4.8 (High Effort) with Mini-SWE-agent scores 80%, compared with 70% for Claude Haiku 4.5 (Thinking) with Mini-SWE-agent.
- Claude Opus 4.8 (High Effort) with Mini-SWE-agent costs $0.23 per test and takes 57.08 seconds; Claude Haiku 4.5 (Thinking) costs $0.18 and takes 120.54 seconds.
Cost Analysis
Cost / Test vs. Accuracy
ACCURACYCOST
Average Token Use / Test
Token Usage
InputOutputReasoningCache readCache write
Claude Haiku 4.5 (Thinking)
anthropic/claude-opus-4-8-high
Cost is the clearest tradeoff in this comparison. anthropic/claude-opus-4-8-high leads at 80.00% for $0.23 per test. Claude Haiku 4.5 (Thinking) is the lower-cost option at 70.00% for $0.18 per test.
Latency Analysis
Latency vs. Accuracy
ACCURACYLATENCY
Average Response Time / Test
Response Time
Claude Haiku 4.5 (Thinking)
anthropic/claude-opus-4-8-high
anthropic/claude-opus-4-8-high is both the most accurate and fastest model in this comparison at 80.00% and 57s.