用 CLAP 加 LoRA 研究自闭症群体的音频情绪识别
Audio emotion recognition for atypical hearing
作者用 LoRA 微调 CLAP 来识别情绪，想解决自闭症听觉过敏难评估的问题，思路挺有意思。
博士研究项目针对自闭症人群的听觉过敏问题，探索音频情绪识别（AER）在非典型听觉场景下的应用。第一阶段用 LoRA 对 CLAP（Contrastive Language-Audio Pretraining）基础模型做微调，训练数据来自神经典型听者的效价与唤醒度数据集。研究假设是基于声学特征的情绪理解可以从小规模标注数据泛化到听觉过敏人群。听觉过敏因个体差异大而难以评估，该工作试图用模型方法补充现有评估手段。
Audio emotion recognition for atypical hearing
My doctoral work aims to explore Audio Emotion Recognition (AER) in the context of atypical listening. This research focuses on auditory hypersensitivity in people with autism, a phenomenon that is often difficult to evaluate and unique to each individual. Our core idea is to leverage our understanding of affect from acoustic traits, relying on the possibility of generalizing affective responses from a small amount of annotated data. As a first step, we fine-tune a large foundation model, Contrastive Language-Audio Pretraining (CLAP) using low-rank adaptation (LoRA), trained on a valence and arousal dataset of neurotypical listeners.