How-to

Naresh Jain 测试 harness 对编码智能体的影响

Why we picked it

Naresh Jain 实测发现给前沿模型套 harness 反而多花 token,弱模型却能明显变强,省钱思路很实用。

Naresh Jain 在 martinfowler.com 发文对比编码智能体有无 harness 的表现。

Image · Martin Fowler
Body

测试发现 harness 会让前沿模型消耗更多 token 而收益很小。但对更弱、更便宜的模型,harness 能明显提升其有效性。

结论是 harness 的价值取决于模型本身的强弱。

Original · Martin Fowler

Naresh Jain compares coding agents with and without a harness. He found it made a frontier model more expensive in tokens for little gain, but make a weaker (and cheaper) model more effective. martinfowler.com/articles/are-h…📊 18 ⚡

Industry Coordinates & Source Verification

This report is categorized under AITOP's "How-to" desk, focusing on US frontier AI labs and Silicon Valley technology leaders. Within our cross-regional analytical framework, it directly maps to AI developer toolchains, coding agents, and engineering workflows. Key entities and technical topics under continuous tracking include 智能体, 编程助手, MCP/工具.

Source attribution: curated from Martin Fowler (@martinfowler).