Public
ucbepic / docetl
Benchmark updated: 8/17/202630 Tasks
A system for agentic LLM-powered data processing and ETL
Languages
Python68.6%TypeScript31.1%Makefile0.1%CSS<0.1%Dockerfile<0.1%JavaScript<0.1%
Harness | Input / Output Cost | ||||||
|---|---|---|---|---|---|---|---|
1 |  Mini-SWE-agent | 9 / 30 | $0.52 | $1.4/$4.4 | 10m42s |
Key Takeaways
- This 30-task result provides a directional benchmark of GLM 5.2 (Fireworks) with Mini-SWE-agent, with a 30% score.
Cost Analysis
Cost / Test vs. Accuracy
ACCURACYCOST
Average Token Use / Test
Token Usage
InputOutputReasoningCache readCache write
No token usage data available.
Cost is the clearest tradeoff in this comparison. GLM 5.2 leads at 30.00% for $0.52 per test. No other model in this comparison is cheaper.
Latency Analysis
Latency vs. Accuracy
ACCURACYLATENCY
Average Response Time / Test
Response Time
GLM 5.2
GLM 5.2 is both the most accurate and fastest model in this comparison at 30.00% and 10m 42s.