Papers

Spatial-TRM:1120 万可训练参数的递归空间推理模型

Look, Reason, Draw a Region: Recursive Refinement for Spatial Context Prediction

Why we picked it

只训练1120万参数就在RoboSpatial-Home上比单步模型高了9个点,总参数只有RoboPoint的十五分之一,做机器人空间理解的可以看看思路。

论文提出 Spatial-TRM,一个用于空间上下文预测的递归推理模型,冻结视觉语言特征,仅训练 1120 万参数。它在 RoboSpatial-Home 基准上达到 29.51% 的上下文准确率,比同参数量的单步模型高 9.02 个百分点。模型支持 6 种空间关系、3 种参考坐标系和开放词表锚定物体。含冻结编码器在内总参数量为 8.778 亿,约为 RoboPoint 报告的 13B 规模的 1/15。

Original · arXiv cs.LG

Look, Reason, Draw a Region: Recursive Refinement for Spatial Context Prediction

Spatial context prediction requires visual grounding and spatial reasoning to identify vacant regions relative to objects in a scene. Spatial relationships and physical constraints remain challenging for large vision-language models (VLMs). Recursive reasoning has demonstrated strong performance on discrete and abstract reasoning tasks, motivating its use for improving spatial context prediction in natural images. Weight sharing enables higher accuracy with a small trainable parameter count. We introduce Spatial-TRM, a compact recursive model with frozen vision-language features, a convex region decoder, and just 11.2M trainable parameters. This weight-tied reasoner supports six spatial relationships, three reference frames, and open-vocabulary anchor objects. On the RoboSpatial-Home benchmark, Spatial-TRM achieves 29.51% context accuracy, a gain of 9.02 percentage points (44.0% relative) over a separately trained single-step model with the same parameter count. Including the frozen encoders, the model has 877.8M total parameters, approximately $15\times$ fewer than the reported 13B size of RoboPoint. These results show that repeated refinement improves spatial context prediction from pretrained vision-language features at a fixed trainable parameter count on this benchmark.