随机对照实验:GPT-4o 做家教能提分,代写则一周后增益消失
Ethan Mollick 晒了用 GPT-4o 做的教学实验:当 Tutor 用成绩涨且能保持,让 AI 代写涨分就没了,家长老师都该看看
一组使用 GPT-4o 的随机对照实验发现,AI 访问能提高学生测试成绩,且部分增益在一周后仍然存在。把 AI 当家教用的学生(augmentation 模式)成绩增益保持,让 AI 直接代写的的学生(automation 模式)增益则消失。该结论来自 Ethan Mollick 分享的多组实验汇总,所有实验均显示正向效果。
Randomized trials with old GPT-4o: "AI access raises test scores, and a smaller gain persists a week later. Gains remain for students who use AI as a tutor (“augmentation”) and fade for students who have AI write for them (“automation”)"
Across all experiments, positive effects. https://t.co/Ux4xDavAYa