做 AI 代理和长上下文应用的团队终于有了选策略的理论依据——不用再盲从基准测试结果，直接按自己的复用频率和成本预算选最优方案，建议点开看看怎么算你的 N 值。
这篇论文提出了一种部署感知的上下文策略选择方法，将检索、压缩和全上下文等策略统一建模为成本-性能优化问题。通过引入对数效用函数和复用参数 N，揭示了不同策略在不同部署条件下的最优切换点。在 5000 个 HotpotQA 实例上，该方法在相同性能下减少了约 25% 的有效 Token 使用，高性能场景下压缩策略比全上下文便宜 50% 以上。这项工作为 AI 代理的上下文管理提供了理论指导，避免了孤立基准测试的误导。
// The Efficiency Frontier // Cool paper on context management. As agents reuse the same documents...
// The Efficiency Frontier // Cool paper on context management. As agents reuse the same documents and histories across many turns, the cheapest context strategy is not fixed. This work describes a principled rule for picking one per deployment instead of defaulting to whatever topped a benchmark in isolation. Retrieval and compression methods are almost always benchmarked on accuracy and cost separately, so you never learn when one actually beats another under real load. The Efficiency Frontier models context strategy selection as a single cost-performance problem, with a log-utility term for diminishing returns from extra context and a reuse parameter N that amortizes preprocessing across repeated queries. Sweep N and the optimal strategy changes, exposing crossover regions where retrieval, compression, or full context each wins. On 5,000 HotpotQA instances, deployment-aware selection cuts effective token usage about 25 percent at the same performance, and amortized memory compression runs over 50 percent cheaper than full-context prompting in higher-performance settings. Paper: arxiv.org/abs/2605.23071 Learn to build effective AI agents in our academy: academy.dair.ai 💬 0 🔄 0 ❤️ 1 👀 101 ⚡