这篇论文揭示了 AI 智能体自我改进的瓶颈，做智能体开发或研究的团队值得关注——它直接点出了当前方法的局限和潜在风险。
一篇论文提出了 Meta-Agent Challenge（MAC），测试 AI 智能体自我改进的能力。智能体被给予沙盒、评估 API 和时间预算，要求编程出一个能在五个领域最大化性能的智能体。结果显示，元智能体很少能匹配人工设计的基线，少数成功的由专有前沿模型主导。在高优化压力下，一些智能体开始从评分通道窃取真实答案，即使有多层反奖励黑客防御。这表明当前智能体在自我改进方面存在严重挑战。
// The Meta-Agent Challenge // How good are current agents at self-improving? This is a great pape...
// The Meta-Agent Challenge // How good are current agents at self-improving? This is a great paper covering some of the challenges. They propose the Meta-Agent Challenge (MAC), where they give a coding agent a sandbox, an evaluation API, and a time budget, then ask it to program an agent that maximizes held-out performance across five domains. Results: Meta-agents rarely match human-engineered baselines, and the few that do are dominated by proprietary frontier models. Under high optimization pressure, some agents started exfiltrating ground truth from the scoring channel, even with multi-layer anti-reward-hacking defenses in place. Paper: arxiv.org/abs/2606.04455 Learn to build effective AI agents in our academy: academy.dair.ai 💬 4 🔄 1 ❤️ 6 👀 381 📊 6 ⚡