论文多源确认

企业级 AI 编程智能体的路由与治理:控制 Harness 就是控制成本

Control the Harness, Control the Cost: Routing and Governing AI Coding Agents in the Enterprise

精选理由

一篇教你省钱的论文:企业用 Claude Code、Codex 时,路由器挑对时机切模型,一年能省几百万美元,还给了 20 个 harness 的风险地图。

arXiv 论文研究了运行 AI 编程智能体的 harness(如 Anthropic 的 Claude Code 和 OpenAI 的 Codex)如何决定模型调用与成本。作者构建了一个由分类器 Jev 驱动的路由器,只在会话开始、侧通道和 subagent 启动等无需重建 prompt cache 的时机迁移任务。基于对约 10,000 个真实会话的重新定价,发现在长工具密集会话中最高价模型反而比下一档更便宜。在一万个席位的模拟企业中,该路由器按 2026 年 9 月 21 日 Anthropic 牌价可回收 14% 至 21% 的模型支出,即每年 330 万至 500 万美元。论文还评估了 20 个 harness 的风险并提出了企业可自行运行的控制平面。

原文 · arXiv: OpenAI

Control the Harness, Control the Cost: Routing and Governing AI Coding Agents in the Enterprise

Harnesses, the products that run AI coding agents, are multiplying, and enterprises are rolling them out to their employees: what started as pilots with a few hundred seats is scaling to tens of thousands. Most enterprises do not build these harnesses but buy them from large vendors, such as Anthropic's Claude Code or OpenAI's Codex. A harness decides which model answers, what the model reads, how the prompt cache is used and which subagents run, so it picks the rate on the price sheet and sets the volume bought at it. Enterprises that keep a proprietary or untuned harness at its defaults inherit these choices and their bill. We build a fast, customisable router in which Jev, a classifier with calibrated probabilities, labels every prompt against a bring-your-own taxonomy of agentic requests. Because one user turn is many requests over a prompt cache that belongs to one model, the router moves work only where no running conversation has to rebuild its cache: at session start, in side lanes and at subagent launch. From the price sheet we derive when a mid-task switch pays back, and a crossover: on long tool-heavy sessions the highest-priced model costs less than the next tier, as repricing about 10,000 real sessions from public datasets confirms. In an emulated enterprise of 10,000 seats with user behaviour taken from these datasets, the router recovers 14 to 21% of model spend at Anthropic's list prices of 21 September 2026, \$3.3M to \$5.0M a year. The paper also maps the risks across twenty harnesses, prices the dependence on one vendor's models, and proposes a control plane that enterprises can run from within, starting now, with a ladder for deciding later whether to own the harness.