这篇论文戳破了AI智能体自主性的泡沫——当前智能体更像是强大的执行者而非自改进的工程师，做智能体开发或自动化研究的团队看完会重新思考自主性的真正门槛。
一篇新论文提出了Meta-Agent Challenge（MAC）基准测试，检验当前AI智能体能否像AI工程师一样自主构建、测试和改进其他智能体，而无需人类干预。测试覆盖数学、科学问答、竞赛编程、软件bug修复和长终端任务五个领域。结果显示，当前智能体在可靠构建任务系统方面仍然薄弱，大多数无法超越人类设计的强基线，少数成功案例主要来自Claude等闭源前沿模型。论文指出，真正的自主不仅需要工具使用，还需要预算意识、失败恢复、压力下的克制以及改进设计的纪律。
This paper tests whether today’s AI agents can bui…
This paper tests whether today’s AI agents can build better AI agents without human design help.
i.e. whether an AI can act more like an AI engineer.
That means it must invent a strategy, write the agent code, test it, learn from failures, and improve the system without a human guiding every choice.
Shows they are still weak at reliably building the systems that do tasks.
Their benchmark, called Meta-Agent Challenge, gives an AI coding agent a safe workspace, a scoring API, limited time, and limited model calls, then asks it to create another agent that performs well on hidden test tasks.
They tested this across 5 areas, including math, science questions, competitive programming, software bug fixing, and long terminal tasks.
The main result is that current agents usually do not beat strong human-made agent setups, and the few good results mostly come from closed frontier models like Claude.
Complete autonomy is not just tool use.
It is budget awareness, failure recovery, restraint under pressure, and the discipline to change designs instead of polishing a bad one.
Overall, Meta-Agent Challenge (MAC) suggests that today’s agents are not yet self-improving engineers.
They are powerful executors with flashes of design judgment, still missing the boring reliability that makes engineering real.
----
Link – arxiv. org/abs/2606.04455
Title: "The Meta-Agent Challenge: Are Current Agents Capable of Autonomous Agent Development?"