Papers

Apple 论文:Claude Opus 5.5 直接控制机械臂,零样本成绩超 VLA 专用模型

Why we picked it

苹果没训练任何机器人模型,只把 Claude Opus 5.5 接上摄像头和机械臂,RoboLab-120 上零样本就拿到 85.6%,比专门训过的 VLA 高了近一倍。做机器人或具身智能的值得看看这个思路,缺点是实时性还跟不上。

Apple 发布论文介绍 AMP1 测试框架,让 Claude Opus 5.5、Gemini 4 Argon 这类通用大模型直接控制机器人机械臂,无需任何演示数据或任务训练。框架只提供相机画面、代码执行接口和底层运动指令,模型自行发明抓取与放置策略。

Body

在 RoboLab-120 基准上,AMP1 零样本成功率达到 85.6%,而训练过演示数据的最佳 VLA 模型为 49.2%,最佳 world-action 模型仅 42.9%。在真实 Franka 机械臂的 108 次试验中成功 104 次。主流 VLA 方案依赖录制演示训练,指令一旦变化就容易失效;AMP1 的做法是用通用模型的推理能力替代专用策略训练。

短板在速度:机器人每个回合大部分时间在等待模型输出。这篇论文对机器人开发者意味着,具身智能可能不一定要从海量演示数据训练开始。

Original · rohanpaul_ai

New Apple paper shows that a general-purpose AI model like Claude Opus 5.5, given camera views and direct control of a robot arm, handled objects more reliably than robot models trained on recorded demonstrations.

New Apple paper shows that a frontier AI model directly controlling a robot arm beats specialist robot policies, with no demonstrations or task training.

Most robot manipulation work trains specialist policies, like vision-language-action models, on demonstrations, and they break easily when instructions change.

Their harness, AMP1, gives a model like Claude Opus 5.5 or Gemini 4 Argon camera views, code execution, and direct motion commands in a loop. It has no built-in grasping or placing skills, so the model invents its own strategies.

On RoboLab-120, AMP1 succeeded in 85.6% of episodes zero-shot, against 49.2% for the best VLA and 42.9% for the best world-action model. On a real Franka arm it succeeded in 104 of 108 trials, though the robot waits much of each episode for the model.

Industry Coordinates & Source Verification

This report is categorized under AITOP's "Papers" desk, focusing on US frontier AI labs and Silicon Valley technology leaders. Within our cross-regional analytical framework, it directly maps to AI developer toolchains, coding agents, and engineering workflows. Key entities and technical topics under continuous tracking include Claude Opus 5.5, Gemini 4 Argon, VLA, 具身智能.

Source attribution: curated from rohanpaul_ai (@rohanpaul_ai).