做AI辅助决策系统或人机协作研究的团队，这篇论文揭示了叙事解释可能带来的隐藏成本——它不一定提升准确率，反而可能拖慢决策并增加盲目信任，值得仔细读读实验设计。
一项大规模人类行为实验评估了LLM生成的叙事解释对分类任务决策表现的影响。研究发现，无论叙事解释的说服力高低，其提升决策准确性的效果并不优于仅提供AI预测。叙事解释增加了用户对AI的依赖，但无论AI预测正确与否，这种依赖都会增强。探索性分析还表明，更具说服力的叙事可能延长决策响应时间，并削弱用户区分正确与错误预测的能力。该研究指出，在AI预测中加入叙事解释可能带来决策表现的权衡，需要更多工作来理解其影响机制。
Human Decision-Making with Persuasive and Narrative LLM Explanations
Large language models (LLMs) have the potential to aid and improve human decision-making in classification tasks, not only by providing fairly accurate predictions, but also in their ability to generate cogent narrative explanations of those predictions. Prior work has demonstrated that people generally find AI narrative explanations to be understandable, trustworthy, and convincing for changing beliefs and opinions; however, less is known about the impact of narrative explanations on objective human decision-making performance. Here we conduct a large-scale human behavioral experiment to evaluate decision-making performance with LLM-generated narrative explanations of varying persuasiveness. We found the degree of persuasiveness, or lack thereof, for LLM-based explanations did not meaningfully impact decision accuracy over a simple AI prediction alone, in agreement with typical results with explainable AI based on feature importance. We found evidence that narratives increased reliance on AI, but both when the AI prediction was correct and incorrect. Exploratory analyses also indicated that the more persuasive narratives may have had a detrimental effect on decision response times and the ability to discriminate between a correct and incorrect AI prediction. Overall, this work indicates that including narrative explanations with AI predictions may involve tradeoffs for decision-making performance, and more work is needed to determine how and when narrative explanations impact human decision-making.