RSPC基准:基于精神科医生标注的数字化关系中的压力与精神状况建模

RSPC: A Benchmark for Modeling Stress and Psychiatric Conditions in Digitally Mediated Relationships using Psychiatrist Annotations

精选理由

想了解AI如何从人际关系中识别心理健康问题?这篇论文用Reddit数据建了专门基准,挺实在。

AI 摘要

研究者发布了RSPC(Relational Stress and Psychiatry Corpus),包含1,799条来自Reddit异地恋版块的帖子,由精神科医生标注了诊断类别(焦虑、抑郁等)、关系压力触发因素和关系阶段。在多项任务中测试了7个微调Transformer模型和5个大语言模型,其中Claude-3-Haiku在障碍分类任务中最佳(Macro-F1=0.538),GPT-4o在关系触发检测任务中最佳(Macro-F1=0.519)。分析发现焦虑障碍与慢性关系不确定性有强关联。RSPC推动心理健康NLP从个体视角转向上下文感知的社会动态建模。

原文 · arXiv cs.LG

RSPC: A Benchmark for Modeling Stress and Psychiatric Conditions in Digitally Mediated Relationships using Psychiatrist Annotations

In NLP, mental health conditions are often modeled as isolated phenomena, without interpersonal context. We use Reddit posts about long-distance relationships to capture both mental health distress and associated relational triggers. We introduce the Relational Stress and Psychiatry Corpus (RSPC) containing 1,799 Reddit posts annotated by psychiatrists for diagnostic categories, including the most prevalent mood disorders (anxiety and depression), relational stressor triggers, and indications of relationship phase. We benchmark seven fine-tuned transformer models and five large language models across multi-label disorder classification, relational trigger detection, and temporal phase prediction tasks. We find clear task-dependent differences between model families, with Claude-3-Haiku achieving the best disorder classification performance (Macro-F1 = 0.538) and GPT-4o obtaining the strongest relational trigger detection performance (Macro-F1 = 0.519), suggesting distinct model capabilities. We further find strong associations between anxiety disorders and chronic relational uncertainty. Overall, RSPC establishes a benchmark for NLP tasks that consider relational context and supports a shift from individual-centric to context-aware mental health modeling that captures the social and temporal dynamics of distress.