Maya a1 论文：选项顺序如何影响非自回归答题模型的输出
Maya a1: Do the Options Read the Model, or Does Their Position? Order Sensitivity in a Non-Autoregressive Decision Model
有人把 Laya 这个一次前向答多选题的小模型拆开测了个遍：选项换个位置，四分之一的题答案就变了，还给出了能把翻转率压到 0.5% 的微调办法。
论文针对 421M 参数的非自回归答题模型 Laya 做选项顺序敏感性实验。在 951 个 Qwen 验证过的多选题上，对选项做循环轮换后，模型有 25.8% 的题目改变答案，英文子集为 19.7%。正确选项放在首位与末位时准确率相差 10.1 个百分点，翻转集中在模型置信度低的三分之一区间（54% 对 8%）。用带选项打乱的 2,818 条数据微调可将翻转率降到 7.2%，不打乱为 11.4%；改用作者提供的并行布局微调后翻转率仅 0.5%。
Maya a1: Do the Options Read the Model, or Does Their Position? Order Sensitivity in a Non-Autoregressive Decision Model
Laya answers typed multiple-choice questions in one forward pass by scoring a hidden state at one [MASK] marker per option. We re-engineer the checkpoint (421M parameters; a 2-layer option head with no positional tensor; a documented but unused parallel layout) and test whether the answer depends on where an option is listed. Presenting 951 Qwen-verified questions under every cyclic rotation of their options (or six random permutations for 12 options), the released checkpoint changes its answer for 25.8% [22.9-28.7] of questions (19.7% on the 605 English-language items alone); accuracy with the gold option first versus last differs by 10.1 points, and the flips concentrate where the model's own confidence is low (54% versus 8% across confidence terciles). Fine-tuning with Laya's trainer on 2,818 teacher-verified rows with option shuffling cuts the flip rate to 7.2%; the identical rows without shuffling give 11.4%, so shuffling is responsible for 4.2 points of the improvement. A confidence-weighted vote over orderings gives 69.7% against 69.1% for a single base pass at 4.1x the compute. Labels are LLM-made and the test sets are teacher-filtered. We also fine-tune with the authors' parallel layout on the same rows: flip rate 0.5%.
