这篇论文研究了隐私控制如何影响你愿不愿意跟AI聊心事,结果发现删除历史比啥高科技都管用。
一项针对354名美国参与者的研究发现,生成式AI聊天机器人(如ChatGPT、Gemini)的安全与隐私控制直接影响用户情感披露意愿。允许删除披露的控制选项对用户积极影响最大,其效果超越本地处理和模型训练退出等技术控制。但用户对控制机制的理解有限,且对控制实际有效性存疑。研究提出了弥合用户理解差距的具体建议。
The Impact of Security and Privacy Controls on Users' Emotional Engagement with Generative AI Chatbots
Chatbots powered by generative AI (e.g., OpenAI's ChatGPT and Google's Gemini) are increasingly being appropriated for emotional support and companionship. These tools offer a suite of security and privacy (S&P) controls, including model training opt-outs and memory toggles, yet how the presence of these controls influences users' attitudes toward emotionally sensitive disclosure remains understudied. We conducted a mixed-methods vignette study with 354 U.S. participants to examine how S&P controls influence users' willingness to engage with generative AI chatbots for emotional support, their perceptions of how protected they are when using these systems, and their perceptions of how effective the chatbots are for providing support. Controls enabling deletion of disclosures had the largest positive impact: these offerings outperformed technically sophisticated controls such as local-only processing and model training opt-outs, where participants expressed difficulty understanding the underlying mechanisms. Yet trust remains fragile, and participants often doubted S&P controls would function as promised. We conclude with actionable recommendations informed by our results to bridge users' comprehension gaps, build credible assurances, and properly calibrate barriers for users in distress.