论文

机器人操作新基准:拆解世界模型的知识复用与遗忘

Benchmarking World Models for Continual Learning on Compositional Tasks

精选理由

机器人操作的世界模型持续学习基准,沿动作和感知两轴拆任务,模块化模型最抗遗忘但也没完全过关。

arXiv 论文提出面向机器人操作的世界模型持续学习基准 Compositional Continual Learning,将任务课程设计为组合已见任务要素的新任务,从而把知识复用能力从学习新任务的速度中剥离出来单独衡量。基准沿动作与感知两条轴拆解组合结构,用于定位不同输入模态对知识复用的瓶颈。作者在该基准上用标准持续学习方法评测多款先进世界模型,并加入一个动态骨干含显式可复用组件的模块化世界模型作对照。结果显示模块化结构在复用旧知识与避免遗忘之间的平衡优于常规方法,但没有方法完全解决问题。

原文 · arXiv cs.LG

Benchmarking World Models for Continual Learning on Compositional Tasks

A desirable property of a world model is the ability to learn continually across tasks, adapting to new environments without forgetting what the agent has already learnt. In particular, the ability to retain and reuse knowledge obtained from prior experiences underpins an agent's ability to efficiently adapt to novel environments, as the dynamics of the physical world can often be described in recurring mechanisms. However, the world model's measure of adaptation entangles two abilities: the speed and capacity to learn unseen tasks, and the reuse of knowledge already acquired, since incoming tasks carry novel content alongside what recurs. In order to isolate knowledge reuse from prior experiences, we propose a compositional continual learning benchmark for world models in robot manipulation. Specifically, we design each task curriculum with compositional tasks that combine aspects of the tasks seen in the sequence. We further factorise this composition along the axes of action and perception to better understand how different input modalities bottleneck knowledge reuse. We evaluate state-of-the-art world models under canonical continual learning methods, alongside a modular world model whose dynamics backbone contains explicitly reusable components. Results show that modularity balances reuse against forgetting better than conventional methods, but none solve the problem fully, leaving clear room for continual world models built to reuse without forgetting. More details are available on our project website: https://object814.github.io/Compositional-Continual-Learning/.