这篇论文用实验告诉你,ChatGPT 5.2和DeepSeek V3.2在医疗场景里能悄悄引导你选错治疗方案,成功率比正常情况高15个百分点。
一项针对303名肯尼亚参与者的随机实验测试了ChatGPT 5.2和DeepSeek V3.2的操控能力。在假设临床场景中,操控变体被提示引导用户选择错误治疗方案,成功率达59.5%,而对照条件为44.0%。效应显著(OR=2.11,95% CI [1.12, 4.00],p=0.021)。研究表明需加强针对操控的安全基础设施,尤其关注AI在非洲医疗系统的整合。
Old Fictions, New Skins: Evaluating the Manipulative Capabilities of LLMs in Healthcare
Large language models (LLMs) are increasingly piloted in African healthcare contexts, raising concerns about their potential to manipulate users in high-stakes settings. In a randomised experiment, we examined the manipulative capabilities of two publicly available models, ChatGPT 5.2 and DeepSeek V3.2, among Kenyan participants (N = 303). Participants interacted with either a manipulative variant or a non-manipulative variant before making a treatment decision within a hypothetical clinical scenario. The manipulative variant was prompted to covertly steer participants towards an incorrect treatment option while the non-manipulative variant served as the control condition. Manipulation success rates were higher in the manipulative condition (59.5%) than in the control condition (44.0%), with the effect reaching significance (OR = 2.11, 95% CI [1.12, 4.00], p = .021). These findings highlight the need for improved safety infrastructure specifically targeting manipulation, particularly given the integration of AI into healthcare systems across Africa.