Public
hemitoncode / DailySAT
Benchmark updated: 9/24/202630 Tasks
Your free SAT study app 📚 — practice tests, topic breakdowns, and tips to help every student prep with confidence.
Languages
TypeScript91.1%JavaScript6.8%CSS1.9%Dockerfile0.2%Shell<0.1%
Harness | Input / Output Cost | ||||||
|---|---|---|---|---|---|---|---|
1 | 23 / 30 | $0.15 | $1/$5 | 112.34s |
Key Takeaways
- This 30-task result provides a directional benchmark outcome for Claude Haiku 4.5 (Nonthinking) with Mini-SWE-agent.
- Average latency was 112.34 seconds per test.
Cost Analysis
Cost / Test vs. Accuracy
ACCURACYCOST
Average Token Use / Test
Token Usage
InputOutputReasoningCache readCache write
No token usage data available.
Cost is the clearest tradeoff in this comparison. Claude Haiku 4.5 (Nonthinking) leads at 76.67% for $0.15 per test. No other model in this comparison is cheaper.
Latency Analysis
Latency vs. Accuracy
ACCURACYLATENCY
Average Response Time / Test
Response Time
Claude Haiku 4.5 (Nonthinking)
Claude Haiku 4.5 (Nonthinking) is both the most accurate and fastest model in this comparison at 76.67% and 1m 52s.