LLM Reasoning Trajectories Budget Confounds
The findings challenge how we interpret LLM reasoning traces, showing difficulty confounds affect performance measurements across models.
The findings challenge how we interpret LLM reasoning traces, showing difficulty confounds affect performance measurements across models.
这篇论文用具体数字告诉你,准确率分数会骗人:同样2048 token,Qwen比DeepSeek多出近10倍的无答案失败,评估时得分开看执行状态和得分。