AI辅助影响技能发展研究:逻辑谜题学习实验

How AI Assistance Affects Human Skill Development: A Study of Learning with Logic Puzzles

精选理由

这项研究揭示了AI辅助对技能发展的潜在影响,对于理解AI在教育中的应用具有重要意义。

AI 摘要

AI辅助可短期提升任务表现,但长期可能阻碍技能发展。实验发现,低成本辅助导致更频繁使用AI。AI辅助阶段请求AI帮助的参与者,在辅助移除后任务表现更差,后续无辅助表现被高估。研究使用贝叶斯潜在能力模型分析技能变化,发现独立解决问题努力与潜在能力提升相关,暗示AI替代独立推理时技能发展较弱。

原文 · arXiv cs.AI

How AI Assistance Affects Human Skill Development: A Study of Learning with Logic Puzzles

While AI assistance can improve human task performance in the short term, it may also undermine the development of skills in the longer term. We examine this tension in a controlled logic-puzzle experiment involving on-demand AI assistance, where participants complete tasks before, during, and after AI is available. By experimentally varying AI request costs, we find that lower-cost assistance induces more frequent AI use. We also find that participants who request AI assistance during the AI-access phase perform worse at the task after assistance is removed, and their subsequent unassisted performance is overestimated when predicted from earlier AI-assisted performance. We use a Bayesian latent ability model to separate initial ability, post-AI ability, and participant-specific skill change, while estimating how independent reasoning during the AI-access phase relates to skill development. The results show that greater independent problem-solving effort is associated with larger gains in latent ability, consistent with the interpretation that skill development is weaker when AI assistance substitutes for independent reasoning.