Papers

QA-CMIF:跨模态填补融合方法提升sEMG惯性手势识别的容错能力

QA-CMIF:Accurate and Lightweight Cross-Modal Latent Imputation and Fusion for Fault-Tolerant sEMG-Inertial Hand Gesture Recognition

Why we picked it

做肌电假肢或可穿戴交互的团队可以看看这篇:QA-CMIF在电极坏掉一半的情况下还能保持识别精度,而且参数量不到0.2M、CPU延迟1.44ms,比传统融合网络轻很多,边缘设备上跑得动。

论文提出QA-CMIF,一个面向sEMG与惯性测量融合手势识别的质量感知跨模态潜空间填补框架,针对日常佩戴中电极脱落、导线断裂等导致的通道损坏问题。该框架对每个sEMG通道独立编码,用软门控评估可靠性,通过置信度加权残差旁路保护完好通道,并利用惯性流和剩余可靠sEMG通道,在坏通道对齐损失约束下用跨注意力机制在潜空间修复受损通道。

Body

在Ninapro DB3、DB2、DB5共29名参与者、17-52类手势的个体内评估中,QA-CMIF在50%通道损坏下比仅门控基线在三个17类任务上高出1.29-2.65个百分点(配对t检验Holm校正p<0.002),在40和52类任务上扩大到2.59-4.15个百分点,比带损坏增强的传统融合高出4.61-19.85个百分点。

模型仅0.175-0.185M参数、2.45-2.63M乘累加运算,2000Hz和200Hz设置下相比近期基线节省46%-55%参数和72%-81%计算量,单线程CPU 99分位延迟1.44ms,适合肌电假肢控制等低功耗可穿戴场景部署。

Original · arXiv cs.LG

QA-CMIF:Accurate and Lightweight Cross-Modal Latent Imputation and Fusion for Fault-Tolerant sEMG-Inertial Hand Gesture Recognition

Fusing surface electromyography (sEMG) with inertial measurements is widely used for myoelectric prosthesis control and wearable human-machine interfaces. In daily wear, however, socket micro-displacement, electrode lift-off, and wire failures often corrupt an unknown subset of sEMG channels through burst artifacts, lift-off shocks, or open-circuit dropouts. Existing fusion networks mix all channels in the first convolutional layer, so a few corrupted electrodes contaminate the entire latent representation, whereas gate-only attenuation of corrupted channels discards the co-activation cues needed to separate fine-grained gestures. We propose QA-CMIF, a quality-aware cross-modal latent imputation and fusion framework that encodes each sEMG channel independently, scores its reliability with a soft gate, and protects intact channels via a confidence-weighted residual bypass, while a cross-attention imputer repairs degraded channels in latent space using the inertial stream and remaining reliable sEMG channels under a bad-channel alignment loss. Across within-subject evaluations on 29 participants from Ninapro DB3, DB2, and DB5 spanning 17-52 gesture classes, QA-CMIF outperformed the gate-only baseline under 50% channel corruption by 1.29-2.65 percentage points, denoted pp, across all three 17-class cohorts with paired-t Holm-adjusted p<0.002, widened this margin to 2.59-4.15 pp on the 40- and 52-class tasks, and surpassed corruption-augmented conventional fusion by 4.61-19.85 pp. Requiring only 0.175-0.185M parameters and 2.45-2.63M multiply-accumulate operations across the 2000 Hz and 200 Hz setups, QA-CMIF saves 46%-55% in parameters and 72%-81% in compute over recent baselines with a 1.44 ms 99th-percentile single-thread CPU latency.

Industry Coordinates & Source Verification

This report is categorized under AITOP's "Papers" desk. Within our cross-regional analytical framework, it directly maps to AI developer toolchains, coding agents, and engineering workflows. Key entities and technical topics under continuous tracking include sEMG, gesture recognition, multimodal, wearables.

Source attribution: curated from arXiv cs.LG (@Xinyu Tao, Shuang Huang, Yeyun Cai, Fang Deng).