论文精选73°

PRIMESCIENTIST 用树状分配实验预算,让科研智能体少做无效尝试

精选理由

这篇讲的是怎么让科研智能体把实验预算花在刀刃上,同预算下比 AutoResearch 奖励高 10.3%,尝试次数省一半,做法挺巧。

PRIMESCIENTIST 是一个科研智能体框架,核心思路是让智能体自己决定实验预算花在哪些方向,而不是一条路径跑到底。它同时维护多个可执行方案的树结构,实验结果会更新各分支的价值评估,预算充裕时多探索、预算减少时集中到强分支。在 12 个 FIRE-Bench 任务上,平均奖励比 AutoResearch 高 10.3%,研究尝试次数少 50.6%,token 预算保持相同。在全部 24 个任务的评估里,它在其中 23 个上用了更少的尝试次数。

原文 · rohanpaul_ai

PRIMESCIENTIST shows that research agents should choose where to spend their experiments, rather than keep pushing the same idea until the budget runs out.

Instead of following a single trajectory, it keeps competing executable plans in a tree. Experiment results update branch values, while the allocation policy explores more when resources are plentiful and concentrates on stronger branches as the budget shrinks.

On 12 FIRE-Bench tasks, it delivered 10.3% higher average reward than AutoResearch while using 50.6% fewer research attempts under the same token budget. Across the full evaluation, it used fewer attempts on 23 of 24 tasks.