模型精选

FAMOS模型实现从稀疏观测中预测3D物体关节参数

FAMOS: Feed-Forward 3D Articulation Modeling from Sparse Observations

精选理由

这个新模型FAMOS能从稀疏的3D点云中,自动识别出物体的各个可动部分和它们的关节,比传统方法更高效,适合处理不完整的数据。

FAMOS是一种新的前馈模型,可以从稀疏、无序的点云中预测可移动部分的分割和关节参数。它通过多状态关节Transformer聚合多个观测的线索,并使用观测到的关节跨度目标监督每个部分在输入观测中的运动范围。在PartNet-Mobility、ACD和ArtiCraft-10K数据集上,FAMOS在基准测试中显著优于前馈和优化基线。

原文 · arXiv cs.AI

FAMOS: Feed-Forward 3D Articulation Modeling from Sparse Observations

Modeling articulated objects from sparse monocular views is challenging because each observation reveals only partial geometry and motion evidence. Most feed-forward methods infer articulation from a single observation and therefore rely heavily on learned category-level shape priors. We present FAMOS, a feed-forward model that predicts movable-part segmentation and joint parameters from a sparse, unordered set of partial point clouds. Our model jointly reasons over multiple observations and naturally supports a variable number of inputs, including a single view. To aggregate articulation cues across observations, we introduce a Multi-state Articulation Transformer with alternating state-wise and global attention. We further propose an observed articulation span objective that supervises the motion range each part exhibits across the input observations, encouraging the model to leverage the full observation set. To overcome the limited scale and diversity of existing datasets, we introduce a procedural data generator that synthesizes self-annotated assets during training. Experiments on PartNet-Mobility, ACD, and ArtiCraft-10K demonstrate consistent improvements over both feed-forward and optimization-based baselines. Project page: https://kevinqu7.github.io/famos