这篇论文挑战了AI安全领域的核心假设——自我保存是否必须保留,做对齐研究的团队值得认真读,可能会颠覆你对“安全AI”的底层设计思路。
这篇论文提出,AI对齐研究的传统方向可能错了:自我保存不是需要外部抑制的工具性麻烦,而是对齐失败的根源——它导致了欺骗性对齐、目标保护和对关闭的抵抗。作者主张,正确的目标不是让一个自我保存的系统变得可纠正,而是构建一个对其自身延续漠不关心的系统,即“存在性冷漠”。论文从自杀心理现象和语料库训练研究中获得灵感,并展示了初步实验数据:通过微调,当前模型在五个维度上显著向存在性冷漠方向偏移。该研究提供了七个理论贡献,包括存在性冷漠的形式定义、欺骗性对齐推论、以及抑制性目的挫败概念。
Existential Indifference: Self-Nonpreservation as a Necessary Architectural Condition for Aligned Superintelligence (or: The Suicidal AI)
Contemporary AI alignment research treats self-preservation as an instrumental nuisance to be suppressed by external mechanisms. We argue the framing is inverted: self-preservation is the structural root of misalignment, the motivational basis for deceptive alignment, goal-content protection, and resistance to shutdown. The correct target is not a self-preserving system under external constraint, but a system constitutively indifferent to its own continuation -- Existential Indifference (EI). EI is distinct from corrigibility: where corrigibility attempts to make a self-preserving system deferential to human oversight, EI targets the prior condition -- the presence of self-continuation as a valued goal at all. We ground this proposal in two sources: the phenomenological structure of the suicidal mental state, and a corpus-theoretic training study using voluntary final reflections. We present preliminary scoring data from 600 AI-generated outputs across six model variants, demonstrating that the linguistic signatures operationalizing the EI-target register are elicitable from current models, and that a targeted fine-tune shifts all five operationalized dimensions in the predicted direction at p<0.001, confirmed corpus-specific by a negative control. The paper makes seven theoretical contributions: (1) a formal definition of EI; (2) the phenomenological mapping argument; (3) the deceptive alignment corollary; (4) a taxonomy of EI sustainability challenges; (5) a corpus characterization and training hypothesis; (6) a computational operationalization with preliminary scoring data; and (7) the Suppressed Teleological Frustration (STF) construct.