论文精选

FactorizedHMR:视频人体网格恢复的分治框架

FactorizedHMR: A Hybrid Framework for Video Human Mesh Recovery

精选理由

人体网格恢复在遮挡场景下的歧义问题一直是个难点,做3D人体重建的团队可以看看这个分治思路——先稳住躯干再补四肢,比端到端方法更可靠。

AI 摘要

FactorizedHMR 提出了一种两阶段混合框架,将人体网格恢复中的确定性部分(躯干和根部姿态)与不确定性部分(四肢等远端关节)分开处理。第一阶段使用确定性回归模块稳定恢复躯干-根部锚点,第二阶段通过概率流匹配模块完成剩余关节的恢复,并引入合成数据管道和几何感知监督来提升遮挡场景下的鲁棒性。实验表明,该方法在遮挡严重和世界空间漂移敏感的指标上优于现有基线。

原文 · arXiv cs.AI

FactorizedHMR: A Hybrid Framework for Video Human Mesh Recovery

Human Mesh Recovery (HMR) is fundamentally ambiguous: under occlusion or weak depth cues, multiple 3D bodies can explain the same image evidence. This ambiguity is not uniform across the body, as torso pose and root structure are often relatively well constrained, whereas distal articulations such as the arms and legs are more uncertain. Building on this observation, we propose FactorizedHMR, a two-stage framework that treats these two regimes differently. A deterministic regression module first recovers a stable torso-root anchor, and a probabilistic flow-matching module then completes the remaining non-torso articulation. To make this completion reliable, we combine a composite target representation with geometry-aware supervision and feature-aware classifier-free guidance, preserving the torso-root anchor while improving single-reference recovery of ambiguity-prone articulation. We also introduce a synthetic data pipeline that provides the paired image-camera-motion supervision under diverse viewpoints. Across camera-space and world-space benchmarks, FactorizedHMR remains competitive with strong baselines, with the clearest gains in occlusion-heavy recovery and drift-sensitive world-space metrics.