这篇论文用SONAR模型把嵌入维度玩出花了，直接用一致性检测解码异常，还尝试修正，挺有意思的。
该论文深入分析了非序列多模态句子级嵌入，重点研究SONAR模型。研究发现某些嵌入维度对扰动敏感，可作为解码异常的指示器。通过利用编码与解码间的一致性，构建了准确的异常检测器。论文还探索了修改特定维度以尝试纠正异常。
Forewarned is Forearmed: When Non-Sequential Embedding Turns Into an Anomaly Detector
This paper offers an in-depth analysis of non-sequential multimodal sentence-level embeddings, with a particular focus on the SONAR model. We demonstrate that certain embedding dimensions are sensitive to perturbations and can serve as indicators of decoding anomalies. By leveraging the consistency between successive encoding and decoding, we successfully build an accurate detector. Additionally, we explore modifying specific dimensions of interest to attempt to correct them. This work underscores the importance of understanding and analyzing the embeddings themselves to enhance the reliability of multimodal representations.