Papers

Harness Scaling:把 harness 多样性变成 agentic RL 的新扩展维度

Harness Scaling for Generalizable Agentic Reinforcement Learning

Why we picked it

arXiv 上的新论文,讲怎么让 RL 训练跨多种 harness 泛化,做智能体训练的可以看看方法设计。

论文提出 Harness Scaling,一种新的 agentic RL 扩展维度,将训练从单一固定 harness 扩展到多样化的执行配置。方法上构建因子化的 harness 空间,用平衡阶乘覆盖挑选紧凑训练子集,并对同一任务组织跨 harness 训练。在多个基准、多种模型规模和 RL 算法上,Harness Scaling 持续提升对未见白盒配置的泛化能力。经结构化白盒变化训练的模型还能迁移到未见的外部黑盒 harness,成绩超过用单一复杂黑盒 harness 训练的模型。

Original · arXiv cs.AI

Harness Scaling for Generalizable Agentic Reinforcement Learning

Agent harnesses have become a central component of modern agentic systems, shaping how models use tools, manage context, and coordinate long-horizon interaction. Realizing the benefits of these harnesses depends on how effectively the underlying model can make use of them, motivating reinforcement learning directly through the harness. However, existing approaches typically train through a single fixed harness, which can lead to specialization and limited transfer across harness configurations. To address this, we introduce \textbf{Harness Scaling}, a new scaling dimension for agentic RL that extends training from a single harness to diverse execution configurations. Concretely, we construct a factorized harness space, select a compact training subset with balanced factorial coverage, and organize cross-harness training to combine global coverage with controlled variation for the same task. Across multiple benchmarks, model scales, and RL algorithms, Harness Scaling consistently improves generalization to unseen white-box configurations. Moreover, models trained through structured white-box variation transfer effectively to unseen external black-box harnesses, outperforming models trained through a single complex black-box harness. These results establish harness diversity as a meaningful scaling dimension for agentic RL and highlight the importance of how this diversity is organized for cross-harness generalization.