Salesforce Research 发布 ANCHOR 基准：测试 AI 陪伴应用的长期人格一致性
Salesforce 做了个 ANCHOR 基准，专门测 AI 陪伴产品聊久了会不会忘事变脸——结果模型记用户近况的能力基本等于瞎猜，做陪伴应用的可以看看。
Salesforce Research 发布 ANCHOR 基准，用 2,008 条合成对话（每条 85–130 个会话）测试四个模型在长期陪伴场景中的人格崩塌与行为漂移。四选一回忆题上模型平均准确率 44.4%，随机猜测为 25%。关于用户状况变化的记忆题准确率仅 21–25%，与瞎猜无异。长上下文、摘要、自我笔记、检索四种记忆方案均未能稳定缩小差距，各模型与记忆组合的准确率在 35.5% 到 63.6% 之间。
Best Friends, Not Forever: Evaluating Long-Horizon Persona Collapse and Behavioral Drift in AI Companions: https://t.co/SV4rSPXQF6
AI companions are expected to keep a consistent role and a shared history with users over time. Our benchmark ANCHOR tests both across 2,008 synthetic conversations, each running 85–130 sessions with four models.
On four-choice questions about what happened earlier in a conversation, models averaged 44.4% accuracy. Random guessing scores 25%.
→ Questions about how a user's situation changed stayed at 21–25%, the level of a guess → Accuracy ranged from 35.5% to 63.6% across model and memory combinations → No tested memory setting (long context, summaries, self-managed notes, or retrieval) consistently closed the gap
The findings point to stronger state updating and temporal memory as the next requirement for companions meant to carry a relationship forward.
#FutureOfAI #EnterpriseAI
