Public
18jeffreyma / OpenHands
Benchmark updated: 8/18/202630 Tasks
🙌 OpenHands: Code Less, Make More
Languages
Python77%TypeScript20.1%Shell1.4%Jinja0.9%JavaScript0.3%Makefile0.2%Other0.2%
Harness | Input / Output Cost | ||||||
|---|---|---|---|---|---|---|---|
1 |  Mini-SWE-agent | 19 / 30 | $0.42 | $1.25/$4.25 | 3m16s |
Key Takeaways
- This 30-task result is a single-run benchmark, so it summarizes one observed outcome without a comparison.
- Muse Spark 1.2 with Mini-SWE-agent records 196.21 seconds of latency per test and a 63.33% score.
Cost Analysis
Cost / Test vs. Accuracy
ACCURACYCOST
Average Token Use / Test
Token Usage
InputOutputReasoningCache readCache write
Muse Spark 1.2
Cost is the clearest tradeoff in this comparison. Muse Spark 1.2 leads at 63.33% for $0.42 per test. No other model in this comparison is cheaper.
Latency Analysis
Latency vs. Accuracy
ACCURACYLATENCY
Average Response Time / Test
Response Time
Muse Spark 1.2
Muse Spark 1.2 is both the most accurate and fastest model in this comparison at 63.33% and 3m 16s.