Toward Scalable Terminal Task Synthesis via Skill Graphs

Zhiyuan Fan, TingHao YU, Yuanjun Cai, JiangTaoGuan, Yun Yang, Dingxin Hu, Jiang Zhou, Xing W, Zhuo Han, feng zhang, Lilin Wang

Keywords: terminal agents, skill graph, verifiable environment scaling

Abstract:

Terminal agents have demonstrated strong potential for autonomous command-line execution, yet their training remains constrained by the scarcity of high-quality and diverse execution trajectories. Existing approaches mitigate this bottleneck by synthesizing large-scale terminal task instances for trajectory sampling. However, they primarily focus on scaling the number of tasks while providing limited control over the diversity of execution trajectories that agents actually experience during training.
In this paper, we present SkillSynth, an automated framework for terminal task synthesis built on a \textit{scenario}-mediated skill graph. SkillSynth first constructs a large-scale skill graph, where scenarios serve as intermediate transition nodes that connect diverse command-line skills. It then samples paths from this graph as abstractions of real-world workflows, and uses a multi-agent harness to instantiate them into executable task instances. By grounding task synthesis in graph-sampled workflow paths, SkillSynth explicitly controls the diversity of minimal execution trajectories required to solve the synthesized tasks.
Experiments on Terminal-Bench demonstrate the effectiveness of SkillSynth: on Terminal-Bench 2.0, Qwen3-32B trained on SkillSynth trajectories reaches 29.6\% accuracy, outperforming the much larger Qwen 3 Coder 480B model (23.9\%) despite using 15$\times$ fewer parameters.

Track: Regular Paper (9 pages)

Email Sharing: We authorize the sharing of all author emails with Program Chairs.

Data Release: We authorize the release of our submission and author names to the public in the event of acceptance.

Submission Number: 182