论文：固定人设无法复现真实群体行为，合成人群模拟存在结构性缺陷
Personas Are Not People: Identity as State, Not Attribute
有人在 arXiv 论证固定人设模拟人群天生有缺陷，还给出了改进设计和实测结果，做用户模拟或评估的可以看看。
arXiv 论文《Personas Are Not People》指出，用固定 persona 驱动语言模型模拟人群的做法有根本问题。作者结合三十年的性格研究与 identity economics，把行为拆成稳定特质、情境唤起的身份和情境本身三部分，并证明基于固定人设的模拟无法复现与具体人群和处境绑定的那部分行为。论文提出 person-in-context 设计，在 Reddit 性格语料和一份临床试验招募调查上测试，结果显示该设计能产生情境依赖的行为，但两种场景下均未能完全匹配真实人群。作者警告合成人群评估可能系统性误判最受情境影响的群体，且加厚 persona 无法修正。
Personas Are Not People: Identity as State, Not Attribute
Synthetic populations, large sets of simulated people, are increasingly used in place of real people to pretest surveys, simulate users and communities, and evaluate AI systems. Each simulated person is defined by a persona, a written profile of fixed traits, demographics, and attitudes that a language model is instructed to act out. Every such system assumes that a person's identity is a stable attribute that behaves the same way in every situation the simulation presents. We show that this assumption is not a harmless simplification. Three decades of personality research find the opposite. How a given person behaves varies more across contexts than people vary from one another. Drawing on identity economics, which describes how different situations activate different identities and norms within the same person, we separate behavior into three parts, which are stable traits, the identity a context calls up, and the situation itself. We then prove, under two stated assumptions, that any simulation built on fixed personas, no matter how detailed the personas or how large the underlying model, cannot reproduce the part of a population's behavior that is specific to it and its circumstances. We propose a new evaluation criterion based on this result and a person-in-context design that can meet it in principle. We test one version on a naturalistic Reddit personality corpus and on a published clinical-trial recruitment survey of a community with documented distrust of medical institutions. The design does produce context-dependent behavior when tested directly, but in neither setting does it fully match the real population, and we show where it falls short. The consequence for practice is a risk that synthetic-population evaluations misrepresent the groups whose behavior is most shaped by context, a distortion that richer personas cannot correct.
