Public
rubyforgood / human-essentials
Benchmark updated: 8/18/202630 Tasks
Human Essentials is an inventory management system for diaper, incontinence, and period-supply banks. It supports them in distributing to partners, tracking inventory, and reporting stats and analytics.
Languages
Ruby73.8%HTML23.6%JavaScript1.7%SCSS0.7%Shell<0.1%Dockerfile<0.1%Other<0.1%
Harness | Input / Output Cost | ||||||
|---|---|---|---|---|---|---|---|
1 |  Mini-SWE-agent | 8 / 30 | $0.03 | $0.44/$1.32 | 4m08s |
Key Takeaways
- This 30-task result provides a directional benchmark outcome for Deepseek V4 Flash 0731 with Mini-SWE-agent.
- Average latency was 247.59 seconds per test, with a cost of $0.03 per test.
Cost Analysis
Cost / Test vs. Accuracy
ACCURACYCOST
Average Token Use / Test
Token Usage
InputOutputReasoningCache readCache write
DeepSeek V4 Flash 0731
Cost is the clearest tradeoff in this comparison. DeepSeek V4 Flash 0731 leads at 26.67% for $0.03 per test. No other model in this comparison is cheaper.
Latency Analysis
Latency vs. Accuracy
ACCURACYLATENCY
Average Response Time / Test
Response Time
DeepSeek V4 Flash 0731
DeepSeek V4 Flash 0731 is both the most accurate and fastest model in this comparison at 26.67% and 4m 8s.