MOJO框架:利用未标记数据提升神经群体解码泛化能力

Leveraging unlabelled data for generalizable neural population decoding

精选理由

MOJO让神经解码模型也能用大量无标签数据,比纯监督学习更强,尤其数据少时效果拔群。

AI 摘要

MOJO(Masked autOencoder-based JOint training)是一个结合自监督掩码自编码与监督学习的训练框架,用于尖峰令牌化模型。在猴子运动皮层、小鼠视觉决策等多区域数据集上,MOJO超越纯监督模型,尤其在少样本微调时性能提升显著。该框架还泛化到人类ECoG语音数据,达到专用神经基础模型水平。

原文 · arXiv cs.LG

Leveraging unlabelled data for generalizable neural population decoding

Robust and accurate neural decoders are integral to neurotechnologies such as brain-computer interfaces and closed-loop experiments. Recent work has shown that tokenizing neural data at the spike level facilitates multi-session pretraining and delivers state-of-the-art decoding performance. However, current spike-based models are restricted to supervised learning (SL), limiting training to datasets with paired behavioural labels. To address this limitation, we introduce MOJO (Masked autOencoder-based JOint training), a training framework for spike-tokenizing models that jointly leverages self-supervised learning (SSL) via masked autoencoding and SL objectives. We evaluate MOJO on three spiking datasets spanning monkey motor cortex during reaching tasks and multi-regional mouse recordings during vision and decision making tasks, demonstrating superior performance over purely SL-trained models. This improvement is especially pronounced when training with limited labelled data, particularly in few-shot finetuning, where only a small amount of labelled data from a new session is available. Incorporating SSL also yields more interpretable neuronal representations, improving performance on brain region classification and spike-statistics prediction without explicit optimization for these tasks. We further show that MOJO generalizes beyond spiking data to human electrocorticography during speech, where it continues to outperform purely SL-trained models and achieves performance comparable to neuro-foundation models (NFMs) designed specifically for continuous signals. Overall, augmenting spike-tokenizing models with SSL improves performance in label-impoverished settings and enables the use of unlabelled data across various tasks and species, while generalizing to other neural modalities. These results suggest a path towards more flexible and scalable data usage when training NFMs.