Partners in Evaluation
Background
SkillsBench asks a focused question: do agents get better at software tasks when you hand them reusable, task-specific knowledge? To answer it, the benchmark runs each model twice with the same agent — once on its own, and once with relevant skills made available. The gap between the two runs is the value the skills add.
The benchmark was introduced by BenchFlow AI, who maintain an official leaderboard and the original repository. We partnered with them to integrate it into Valkyrie, which let us add it to the site quickly.
You can find that implementation in our new public benchmark registry, where the community can contribute benchmarks that are compatible with Valkyrie.
Results
Each row compares the same model without skills and with skills.
Skills lifted strong and weak models alike.
DeepSeek V4.1 Flash (OpenHands) tops the with-skills board at 69.80%, followed by Grok 4.5 (OpenHands) at 66.03% and Gemini 3.7 Flash (OpenHands) at 65.89%, with GPT 5.5 (Codex) next at 62.55%.
Agent skill uses that were observed across each of the runs, these were collected from the traces and do not reflect internal skill uses that are not logged.
Skill usage varies widely across models, and even across agents for the same model. On Codex, GPT 5.5 references skill paths far more than anything else, while the same base model on OpenHands, GPT 5.5, is among the lightest.
Methodology
Every model runs the same SkillsBench task set in two conditions:
- No Skills — the agent gets its default tools and prompt.
- With Skills — the same agent, plus task-specific skills.
The default agent is OpenHands-CLI, with the commit locked at 3ca17446c5d9c1e35e054803478a3501ec251ecf. The Codex row uses Codex with the same GPT-5.5 base model.
We run three trials per model in each condition. For each task we average the score across the three trials, then average those task scores into the model’s final accuracy.
The observed skill reference chart counts observed agent skill uses in With Skills runs. Each unique skill action counts once.
All runs use the public SkillsBench task definitions and run protocol.
Citation (BibTeX)
@misc{li2026skillsbench,
title = {SkillsBench: Benchmarking How Well Agent Skills Work Across Diverse Tasks},
author = {Xiangyi Li and Wenbo Chen and Yimin Liu and Shenghan Zheng and Xiaokun Chen and Yifeng He and Yubo Li and Bingran You and Haotian Shen and Jiankai Sun and Shuyi Wang and Qunhong Zeng and Di Wang and Xuandong Zhao and Yuanli Wang and Roey Ben Chaim and Zonglin Di and Yipeng Gao and Junwei He and Yizhuo He and Liqiang Jing and Luyang Kong and Xin Lan and Jiachen Li and Songlin Li and Yijiang Li and Yueqian Lin and Xinyi Liu and Xuanqing Liu and Haoran Lyu and Ze Ma and Bowei Wang and Runhui Wang and Tianyu Wang and Wengao Ye and Yue Zhang and Hanwen Xing and Yiqi Xue and Steven Dillmann and Han-chung Lee},
year = {2026},
eprint = {2602.12670},
archivePrefix = {arXiv},
url = {https://arxiv.org/abs/2602.12670},
}