GDPval 后继基准发布，Ethan Mollick 指出缺少人类基线
Why we picked it
Ethan Mollick 聊了 GDPval 的后继基准，还发现 GPT-6 Pro 能挑出评分错误，做模型评测的可以看看
GDPval 的后继基准上线，用于评估 AI 完成真实工作任务的表现。Ethan Mollick 认为该基准仍需像 GDPval 一样补充人类表现基线。他提到 GPT-6 Pro 在评分中发现了若干错误，且 0% 的得分掩盖了不同模型在经济意义上的成功率差异。
Original · Ethan Mollick
Nice to see a successor to GDPval to evaluate AI work but really needs human baselines like GDPval.
Funnily enough, GPT-6 Pro spotted some errors in the grading. I also think the 0% scores hide economically meaningful differences in success rates. But still a valuable benchmark! https://t.co/mfKfsKzcpM
