Public
pallets-eco / flask-wtf
Benchmark updated: 10/6/20261 Task
Simple integration of Flask and WTForms, including CSRF, file upload and Recaptcha integration.
Languages
Python100%
Harness | Input / Output Cost | ||||||
|---|---|---|---|---|---|---|---|
1 |  Mini-SWE-agent | 1 / 1 | $0.01 | $0.2/$1.2 | 67.00s | ||
2 | Mini-SWE-agent | 1 / 1 | $0.92 | $5/$25 | 3m17s |
Key Takeaways
- Claude Opus 5 with Mini-SWE-agent resolves 1 of 1 tasks for $0.92 per test in 197 seconds.
- GPT-5.6 Luna with Mini-SWE-agent resolves 1 of 1 tasks for $0.01 per test in 67 seconds.
- Both models achieve a 100% score, but the single-task result is directional rather than conclusive.
Cost Analysis
Cost / Test vs. Accuracy
ACCURACYCOST
Average Token Use / Test
Token Usage
InputOutputReasoningCache readCache write
Claude Opus 5
GPT-5.6 Luna
Cost is the clearest tradeoff in this comparison. Claude Opus 5 leads at 100.00% for $0.92 per test. GPT-5.6 Luna is the lower-cost option at 100.00% for $0.01 per test.
Latency Analysis
Latency vs. Accuracy
ACCURACYLATENCY
Average Response Time / Test
Response Time
Claude Opus 5
GPT-5.6 Luna
Latency separates several models with similarly strong scores. Claude Opus 5 leads at 100.00%, while GPT-5.6 Luna is fastest at 1m 7s with 100.00% accuracy.