论文精选73°

MM-Spectrum:多模态多光谱分子结构解析

MM-Spectrum: Multimodal Multi-spectral Molecular Structural Elucidation with a Stable MoE Framework

精选理由

研究人员提出 MM-Spectrum 框架,解决了多光谱信号异质性问题,在分子结构解析任务中表现优异。

AI 摘要

MM-Spectrum 是一种稀疏 MoE 框架,专为多模态多光谱光谱到结构解析设计。该框架引入了显式模态感知路由机制,结合共享和交互专家,以及异构专家容量。在完整模态、双模态和缺失模态设置下,MM-Spectrum 在分子结构解析任务中取得了一致的显著改进。

原文 · arXiv cs.LG

MM-Spectrum: Multimodal Multi-spectral Molecular Structural Elucidation with a Stable MoE Framework

Inferring molecular structures from multimodal spectroscopic measurements requires integrating complementary yet highly heterogeneous signals. However, the common paradigm of directly concatenating multispectral sequences can exhibit anomalous performance degradation, primarily due to pronounced heterogeneity and the resulting multimodal imbalance across modalities. As a remedy, we propose MM-Spectrum, a sparse Mixture-of-Experts framework tailored for multimodal multispectral spectra-to-structure elucidation. To better match the information characteristics under multispectral imbalance, MM-Spectrum introduces an explicit modality-aware routing mechanism that exposes spectral identity to the router in addition to token content representations. Moreover, it incorporates shared and interaction experts, together with heterogeneous expert capacities, to extract multispectral modality-unique and cross-modal synergistic information while suppressing noise-induced interference. Across full-modality, bimodal, and missing-modality settings on molecular structural elucidation, MM-Spectrum achieves consistent and substantial improvements, supported by ablation studies and interpretability analyses.