想自己调agent的提示和流程？这篇论文把控制层拆成六块，不用额外标签就能自动优化，比固定harness效果好不少。
论文提出 MemoHarness，将 LLM agent 的 harness（外部控制层）分解为上下文、工具、生成、编排、记忆、输出六个可编辑面。它通过检索相似案例自动为每个新场景调整 harness，无需测试时标签或梯度更新。在 shell-agent 基准测试中，MemoHarness 达到 0.806 分，优于最强固定 harness 基线的 0.722。每任务成本低于最强商业基线。
Great research paper on optimizing harnesses. (bookmark it) There is a lot of alpha in building a ...
Great research paper on optimizing harnesses. (bookmark it) There is a lot of alpha in building a harness. And you don't need much to keep them optimized. This paper argues you can do this effectively using the harness own executions. The harness is the external control layer that turns a base LLM into an executable agent. Automatic improvement methods optimize a narrow part of it, usually prompts or pipelines, and deployed agents then reuse a single global harness for every case. MemoHarness decomposes the harness along the temporal flow of inference into six editable control surfaces (context, tool, generation, orchestration, memory, output) and turns improvement into structured editing over those dimensions. It documents per-case diagnoses plus distilled global patterns about what works and how dimensions interact, then adapts to each new case by retrieving similar past cases. No compute is waisted on test-time labels, feedback, gradient updates, or extra search. On the shell-agent benchmark it reaches 0.806 against 0.722 for the strongest fixed-harness baseline, at lower per-task dollar cost than the strongest commercial baselines compared. Paper: arxiv.org/abs/2607.14159 Learn to build effective AI agents in our academy: academy.dair.ai 💬 10 🔄 2 ❤️ 35 👀 2905 📊 20 ⚡
- shao__meng07-16 01:49原文