这篇论文颠覆了「检索必须靠语义索引」的直觉,做 AI Agent 或搜索系统的开发者值得一读——它可能改变你对工具接口设计的思考方式。
一篇新论文发现,AI Agent 使用 grep、文件读取等基本终端工具直接搜索原始数据,在多个基准测试中表现远超传统检索系统。在 BrowseComp-Plus 上,将语义检索替换为终端搜索后,准确率从 69% 提升至 80%,同时降低了成本。论文指出,检索不仅是模型问题,更是接口问题——传统检索将语料库简化为一次查询、一个排名列表,而直接交互允许 Agent 搜索精确字符串、检查上下文、发现新实体并反复验证假设。提升主要来自从已找到的文档中提取更多可用证据,而非找到更多相关文档。该方法的局限是随着语料库增长,找到第一个有用锚点的成本会快速上升。
Better search may come less from smarter indexes t…
Better search may come less from smarter indexes than from giving agents a richer way to touch text.
Shows that AI agents using basic terminal tools like grep, file reads, and shell commands to search raw data perform far better than conventional retrieval systems on multiple benchmarks.
On BrowseComp-Plus, swapping semantic retrieval for terminal search raised accuracy from 69% to 80% while lowering cost.
The deeper point is not that grep is magically smarter than embeddings.
It is that retrieval is usually treated as a model problem, when it is also an interface problem.
A conventional retriever turns the corpus into a narrow ritual: ask once, receive a ranked list, reason over whatever survived.
That works when the question is close to a document’s semantic center, but it breaks when the answer depends on exact phrases, faint clues, document structure, or a chain of small discoveries.
Direct Corpus Interaction changes the shape of the task.
The agent can search an exact string, inspect nearby context, notice a new entity, constrain the search again, and keep testing its hypothesis against the raw files.
Here’s the part most people miss: the gain was not mainly from finding more gold documents, but from extracting more usable evidence once a promising document was reached.
That makes DCI less like a better search engine and more like giving the model fingers.
The limitation is real: as the corpus grows, the cost of finding the first useful anchor rises quickly, and blunt terminal search will not replace indexes for every large, static collection.
But the paper’s lesson still lands cleanly.
For capable agents, the bottleneck may no longer be only what they know, or even how they reason, but how much of the world their tools allow them to touch.
----
Paper Link – arxiv. org/abs/2605.05242
Paper Title: "Beyond Semantic Similarity: Rethinking Retrieval for Agentic Search via Direct Corpus Interaction"