做合成数据后训练管线的团队会感兴趣——这篇论文用实验证明了来源证据门控和适应性恢复策略能显著提升数据质量,比简单重采样更高效,建议做数据筛选的开发者点开看看具体方法。
这篇论文研究了合成后训练数据筛选中的两个关键问题:过滤信号是否基于生成样本的来源证据,以及被拒绝的样本能否被系统性地恢复而非永久丢弃。作者通过对抗性注入语料库提供真实失败标签,在多种门控配置、恢复策略和生成器规模下进行了受控实验。研究发现,精确的来源证据能提升强评判器的忠实度门控效果;幻觉门控和奖励门控拒绝的样本群体几乎不重叠,因此两者都必要;结合失败诊断与定向再生成的适应性恢复管线,在产出率、恢复率和注入召回率上均优于简单重采样。下游微调质量主要由生成器规模决定,过滤和恢复条件虽有贡献但属于次要因素。
Synthetic post-training pipelines commonly filter generated samples with reward models or holistic LLM judges, yet two practices remain rarely examined together: whether the filtering signal is grounded in the source evidence that induced each generation, and whether rejected samples can be systematically recovered rather than permanently discarded. We present a controlled study of both questions across gate configurations, recovery strategies, and generator scales, using adversarially injected corpora to provide ground-truth failure labels. We find that exact source provenance improves faithfulness gating for stronger judges, that hallucination and reward gates reject largely disjoint sample populations making both necessary, and that an adaptive recovery pipeline combining failure diagnosis with targeted regeneration achieves higher yield, recovery rate, and injection recall than naive resampling. Downstream fine-tuning quality is driven primarily by generator scale, with filtration and recovery conditions contributing meaningfully but secondarily.