做智能体自我改进的开发者，这篇论文戳破了「准确率越高越好」的幻觉，给出了衡量真正发现的新标准，值得仔细读一读。
本周一篇突出的人工智能论文探讨了自我改进智能体是否真正发现新知识，还是仅仅在已有知识中检索或组合。作者将智能体的行为分为三类：检索（查找已有信息）、搜索（以新方式组合工具）和发现（发明新概念）。他们通过范畴论和左 Kan 扩展定义了一个数学框架，判断智能体是否产生了真正的新结果。论文构建了一个 Builder/Breaker 智能体研究蛋白质力学，其拟合精度虽下降，但覆盖了更难的蛋白质，数据量增长近 10 倍而代码仅增长 1.3 倍，表明真正的科学进步是压缩更多世界知识到更少代码中。该研究为智能体提供了更清晰的成功信号，避免仅优化准确率而陷入简单基准。
This was one of the standout AI papers of the week. (bookmark it) It tackles a question most self-...
This was one of the standout AI papers of the week. (bookmark it) It tackles a question most self-improving AI agents ignore: is the agent actually discovering anything, or just remixing what it already knows? How can you tell whether the agent is doing real discovery or just confident retrieval? The authors give three clean buckets: - Retrieval is looking something up in a notebook you already have. - Search is combining tools you already own in new ways. - Discovery is inventing a new concept that wasn't in your toolkit before. The issue is that most agents stop at the first two. The math behind their definition (category theory plus a left Kan extension, if you care) is basically a bookkeeping trick to ask: could the old version of me have produced this result? If yes, it's not discovery. If no, something genuinely new showed up. They build a Builder/Breaker agent that studies protein mechanics. Over four rounds, the model's fit accuracy actually drops (R² goes from 0.48 to 0.68 to 0.54 to 0.41). At first glance, that looks like a failing agent. It isn't. The agent kept taking on harder proteins and rewriting its theory to cover them. Data grew almost 10x while the model code grew only 1.3x. A smaller theory covering a bigger world is exactly what good science looks like. Why does it matter? If you optimize for accuracy alone, your self-improving agent will just settle into easy benchmarks and stop. This paper offers a cleaner success signal and asks whether the agent is compressing more of the world into less code over time. Paper: arxiv.org/abs/2606.01444 Learn to build effective AI agents in our academy: academy.dair.ai 💬 20 🔄 25 ❤️ 164 👀 16867 📊 66 ⚡