Public
cynepiaadmin / cocoindex
Benchmark updated: 8/18/202630 Tasks
Data transformation framework for AI. Ultra performant, with incremental processing. 🌟 Star if you like it!
Languages
Rust68.8%Python30.9%Shell0.2%Handlebars<0.1%
Harness | Input / Output Cost | ||||||
|---|---|---|---|---|---|---|---|
1 |  Mini-SWE-agent | 19 / 30 | $3.51 | $5/$25 | 10m55s |
Key Takeaways
- This single 30-task run provides a directional result for Claude Opus 5 with Mini-SWE-agent.
- Claude Opus 5 with Mini-SWE-agent resolved 63.33% of the supplied tasks.
Cost Analysis
Cost / Test vs. Accuracy
ACCURACYCOST
Average Token Use / Test
Token Usage
InputOutputReasoningCache readCache write
No token usage data available.
Cost is the clearest tradeoff in this comparison. Claude Opus 5 leads at 63.33% for $3.51 per test. No other model in this comparison is cheaper.
Latency Analysis
Latency vs. Accuracy
ACCURACYLATENCY
Average Response Time / Test
Response Time
Claude Opus 5
Claude Opus 5 is both the most accurate and fastest model in this comparison at 63.33% and 10m 55s.