Public

hemitoncode / DailySAT

Benchmark updated: 9/24/202630 Tasks
Add models

Your free SAT study app 📚 — practice tests, topic breakdowns, and tips to help every student prep with confidence.

Languages

TypeScript91.1%JavaScript6.8%CSS1.9%Dockerfile0.2%Shell<0.1%

Harness

1

Mini-SWE-agent
23 / 30

$0.15

112.34s

Key Takeaways

  • This 30-task result provides a directional benchmark outcome for Claude Haiku 4.5 (Nonthinking) with Mini-SWE-agent.
  • Average latency was 112.34 seconds per test.

Cost Analysis

Cost / Test vs. Accuracy
ACCURACYCOST

Average Token Use / Test

Token Usage
InputOutputReasoningCache readCache write

No token usage data available.

Cost is the clearest tradeoff in this comparison. Claude Haiku 4.5 (Nonthinking) leads at 76.67% for $0.15 per test. No other model in this comparison is cheaper.

Latency Analysis

Latency vs. Accuracy
ACCURACYLATENCY

Average Response Time / Test

Response Time
Claude Haiku 4.5 (Nonthinking)
1m 52s

Claude Haiku 4.5 (Nonthinking) is both the most accurate and fastest model in this comparison at 76.67% and 1m 52s.