Public
fmtlib / fmt
Benchmark updated: 9/4/202630 Tasks
A modern formatting library
Languages
C++95.7%Python2%CMake1.7%C0.4%Shell<0.1%Cuda<0.1%Other<0.1%
Harness | Input / Output Cost | ||||||
|---|---|---|---|---|---|---|---|
1 |  Mini-SWE-agent | 25 / 30 | N/A | $2/$6 | N/A | ||
2 | Mini-SWE-agent | 22 / 30 | N/A | $1.4/$4.4 | N/A | ||
3 | Mini-SWE-agent | 5 / 30 | N/A | $1.25/$4.25 | N/A |
Cost Analysis
Cost / Test vs. Accuracy
ACCURACYLATENCY
Average Token Use / Test
Token Usage
InputOutputReasoningCache readCache write
No token usage data available.
Latency Analysis
Latency vs. Accuracy
ACCURACYLATENCY
Average Response Time / Test
Response Time
No response-time data available.