Microsoft paper ScholarEvolve evolves agent harnesses from research papers
The counterintuitive idea is that the literature, not runtime traces, is the highest-value source of harness improvements. Builders tuning agent scaffolds around a fixed model can replicate the module-and-topic-modeling loop with their own paper corpus instead of paying for a model upgrade. Results on AppWorld Challenge and Tau2-Bench Telecom give a concrete baseline for comparing it against failure-log-driven harness tuning.
Microsoft and colleagues released ScholarEvolve, a paper proposing that agent harnesses be evolved from published research rather than from the agent's own failure logs.
The harness is split into modules for tool use, memory management and task execution.Topic modeling runs over recent papers to identify distinct improvement strategies for each module, and combinations are implemented and tested;
new papers can be added over time.With the underlying model held fixed, Qwen3.
5-27B goal completion on AppWorld Challenge rises from 49.6% to 63.
6%, and GPT-5.4-mini on Tau2-Bench Telecom rises from 72.
7% to 81.9%.
The paper is available at arxiv.org/abs/2609.
40169.
New paper from Microsoft and colleagues on evolving agent harnesses. It's a really cool idea to evolve a harness from published research. Something I have also been testing for the past couple of months. ScholarEvolve proposes harness changes based on published agent research rather than the agent's own failure logs. It splits the harness into modules for tool use, memory management, and task execution. It runs topic modeling over recent papers to identify distinct improvement strategies for each module, then implements and tests combinations. New papers can be added over time. With the model held fixed, Qwen3.5-27B goal completion on AppWorld Challenge rises from 49.6% to 63.6%, and GPT-5.4-mini on Tau2-Bench Telecom rises from 72.7% to 81.9%. Paper: arxiv.org/abs/2609.40169 Chat with Paper: academy.dair.ai/papers/learnin…📊 10 ⚡
This report is categorized under AITOP's "Papers" desk, focusing on US frontier AI labs and Silicon Valley technology leaders. Within our cross-regional analytical framework, it directly maps to AI developer toolchains, coding agents, and engineering workflows. Key entities and technical topics under continuous tracking include ScholarEvolve, Microsoft, AppWorld, Tau2-Bench.
Source attribution: curated from elvis (@omarsar0).