NVIDIA 实验室提出 ARDY,能实时生成高质量人体运动,支持文本+约束控制,比传统方法更可控、更快速。
ARDY 是一个流式生成框架,采用混合表示(显式根特征与潜在身体嵌入)和两阶段自回归变压器去噪器,支持在线文本提示和灵活的运动学约束。在 HumanML3D 基准和 Bones Rigplay 数据集上的评估显示,其运动质量和约束遵循度高。通过交互式演示展示动态文本控制、关键帧姿势约束、路径跟随和鼠标键盘运动控制。代码和模型已发布。
ARDY: Autoregressive Diffusion with Hybrid Representation for Interactive Human Motion Generation
Generating realistic 3D human motions in real-time within interactive applications is key for animation, simulation, and humanoid robotics. While recent offline motion generation approaches offer precise control via text and kinematic constraints, they lack the inference speed required for interactive settings. Conversely, existing online methods enable real-time synthesis but often sacrifice controllability or struggle with complex text semantics and long-horizon goals due to limited context windows. In this work, we introduce ARDY, a streaming generation framework that bridges this gap by enabling high-fidelity motion generation controllable via online text prompts and flexible kinematic constraints. ARDY employs a hybrid representation that combines explicit root features with a latent body embedding, balancing precise trajectory control with efficient generative learning. We propose a two-stage autoregressive transformer denoiser that features variable history context and supports conditioning on flexible, long-horizon kinematic constraints. By training on a large-scale motion capture dataset and being directly conditioned on text labels and kinematic constraints sampled from ground truth poses, ARDY natively learns controllable generation that supports online prompting and flexible long-horizon goals. Extensive evaluations on the HumanML3D benchmark and the large-scale, high-fidelity Bones Rigplay dataset demonstrate ARDY's high motion quality and constraint adherence, validating the efficacy of our key architectural decisions. Finally, we demonstrate the method's practical versatility through an interactive demo featuring dynamic text control, diverse keyframe pose constraints, path following, and interactive locomotion control via mouse and keyboard. Supplementary video results, code, and model releases can be found at https://research.nvidia.com/labs/sil/projects/ardy/.