Public

Lemonawa / music163bot-rust

Benchmark updated: 9/16/202630 Tasks
Add models

Rust-powered Netease Music Bot. Built on 1% documentation and 99% pure vibes.

Languages

Rust100%

Harness

1

Mini-SWE-agent
28 / 30

$1.03

7m08s

2

Mini-SWE-agent
25 / 30

$3.14

10m16s

Key Takeaways

  • GPT-5.6 Sol with Mini-SWE-agent scores 93.33%, versus 83.33% for Claude Opus 5 with Mini-SWE-agent.
  • GPT-5.6 Sol with Mini-SWE-agent costs $1.03 per test and takes 428.33 seconds, compared with $3.14 and 616.40 seconds for Claude Opus 5 with Mini-SWE-agent.
  • With 30 tasks, these results are not a smoke test or directional-only comparison.

Cost Analysis

Cost / Test vs. Accuracy
ACCURACYCOST

Average Token Use / Test

Token Usage
InputOutputReasoningCache readCache write

No token usage data available.

Cost is the clearest tradeoff in this comparison. GPT-5.6 Sol leads at 93.33% for $1.03 per test. No other model in this comparison is cheaper.

Latency Analysis

Latency vs. Accuracy
ACCURACYLATENCY

Average Response Time / Test

Response Time
Claude Opus 5
10m 16s
GPT-5.6 Sol
7m 8s

GPT-5.6 Sol is both the most accurate and fastest model in this comparison at 93.33% and 7m 8s.