Public
psf / requests
Benchmark updated: 10/13/202630 Tasks
A simple, yet elegant, HTTP library.
Languages
Python99.4%Makefile0.6%
Harness | Input / Output Cost | ||||||
|---|---|---|---|---|---|---|---|
1 |  Mini-SWE-agent | 30 / 30 | $0.89 | $5/$25 | 3m27s |
Key Takeaways
- This single 30-task result is a complete run, not a comparison.
- Claude Opus 5 with Mini-SWE-agent achieves a 100% score on the supplied requests benchmark.
Cost Analysis
Cost / Test vs. Accuracy
ACCURACYCOST
Average Token Use / Test
Token Usage
InputOutputReasoningCache readCache write
Claude Opus 5
Cost is the clearest tradeoff in this comparison. Claude Opus 5 leads at 100.00% for $0.89 per test. No other model in this comparison is cheaper.
Latency Analysis
Latency vs. Accuracy
ACCURACYLATENCY
Average Response Time / Test
Response Time
Claude Opus 5
Claude Opus 5 is both the most accurate and fastest model in this comparison at 100.00% and 3m 27s.