DualWorldBench:评测智能体在符号与具身世界中的规划能力
DualWorldBench: Can Agents Plan Deliveries across Symbolic and Grounded Worlds?
一个新基准 DualWorldBench,专门测智能体做多目标规划的真实水平,实验发现感知好不代表规划好,做 Agent 评测的可以看看。
研究者提出 DualWorldBench,用统一的取货-送货任务评测智能体在多目标规划下的感知与推理能力。基准包含三部分:TextWorld 测试时间约束下的符号规划,SimWorld 测试拓扑变化下的具身路径规划,DualWorld-VQA 诊断感知、场景理解与规划。实验显示现有智能体在时间约束下难以推导最优任务顺序,具身观察也难以稳定转化为可行的动作序列,感知能力并不必然带来约束规划能力。
DualWorldBench: Can Agents Plan Deliveries across Symbolic and Grounded Worlds?
Recent multimodal agents have shown promising progress in embodied planning and web interaction. However, existing evaluations often rely on simplified tasks with limited combinatorial structure, leaving it unclear whether current agents can robustly integrate perception and reasoning for multi-goal planning under temporal, physical, and multimodal constraints. We introduce DualWorldBench, a unified benchmark for evaluating agent planning under controlled symbolic--temporal and grounded--topological complexity. Built around a shared pickup--delivery interface, DualWorldBench consists of three complementary components: TextWorld, which isolates symbolic planning under varying task compositions and release dynamics; SimWorld, which evaluates grounded path planning under controlled topological variation with text, image, or multimodal inputs; and DualWorld-VQA, a diagnostic suite spanning perception, scene understanding, and planning. Experiments reveal a common gap between local understanding and globally consistent planning. In TextWorld, agents struggle to derive optimal task sequences under interacting temporal constraints; in SimWorld, grounded observations are not reliably converted into feasible action sequences. DualWorld-VQA further confirms that perception and topology understanding do not necessarily translate into constrained planning. Together, these results identify the central challenge as composing symbolic or grounded evidence into globally feasible and efficient multi-goal plans. These findings establish DualWorldBench as a challenging testbed for agents with tighter perception--reasoning--planning integration. All datasets and code are publicly available at our project website https://dualworld.netlify.app/.