Papers

RTRBM 用于生物力学运动序列的无监督编码研究

Recurrent Temporal Restricted Boltzmann Machines as Unsupervised Encoders for Biomechanical Movement Sequences

Why we picked it

有人把 RTRBM 搬来编码生物力学数据,接进了 SIT-FUSE 管线,结论挺诚实:嵌入赢了 PCA 和自编码器,但干不过简单统计量。

arXiv 上一篇论文将 Recurrent Temporal Restricted Boltzmann Machine(RTRBM)改造成无监督编码器,把连续的生物力学运动数据窗口映射为定长嵌入。作者将其适配连续信号、堆叠成深层结构,并接入 SIT-FUSE 分割管线,在模拟肌肉骨骼够物任务和两个真实步态数据集上用聚类、重建和步行速度分类评估。嵌入聚类在无标签情况下能恢复朝向目标的运动结构,且可迁移到未见过的序列;在步态数据上,嵌入在非线性探针下优于 PCA 和自编码器基线。但结果也显示:移除循环连接在够物任务上没有可测量的损失,简单的逐通道统计量在步行速度分类上表现不逊于学到的嵌入。

Original · arXiv cs.LG

Recurrent Temporal Restricted Boltzmann Machines as Unsupervised Encoders for Biomechanical Movement Sequences

Biomechanical movement recordings are continuous, high-dimensional time series, and analyzing them without manually labeling them requires representations that capture how movements evolve over time. Most unsupervised representation-learning pipelines, however, treat each observation frame independently and discard this temporal structure, while energy-based models that could capture it have not extensively been adapted to biomechanical signals. So, this paper implements the Recurrent Temporal Restricted Boltzmann Machine (RTRBM), a recurrent energy-based model, into an unsupervised encoder that maps windows of movement data to fixed-length embeddings, and tests what its recurrent structure contributes. We adapt the model to continuous-valued signals, stack it into a deep architecture, and integrate it into the SIT-FUSE segmentation pipeline. We evaluate the embeddings on simulated musculoskeletal reaching and on two real gait datasets, using clustering, reconstruction, and walking-speed classification of unseen subjects, and compare them against non-recurrent and non-probabilistic baselines, including a control that removes the recurrent connection. Clustering the embeddings recovers movement structure tied to progress toward the target without any labels, which also transfers to unseen episodes. On gait data, the embeddings outperform PCA and autoencoder baselines under a nonlinear probe. However, removing the recurrent connection does not yield a measurable loss on the reaching task, and simple per-channel summary statistics classify walking speed at least as well as the embeddings. The model is therefore a working, verified encoder for SIT-FUSE, while the evidence for a benefit of recurrence is mixed, and the learned embeddings did not outperform simple summary statistics on gait.