Training on verified execution traces can bake retrieval-dependent prompt skills into model weights, reducing reliance on the agent finding and following instructions at runtime. Teams building coding agents can replicate the recipe by turning their own skill libraries into checkable sandbox tasks. The work comes from a Chinese lab and benchmarks on Claude Code with Qwen, making it a useful reference point against prompt-based skill systems like Claude Skills.
Latest
A 27B open-weights model running locally now solves multi-digit addition-in-words at near-perfect accuracy, a task GPT-4o fumbled two years ago. Practitioners evaluating small local models for arithmetic-adjacent workflows get a concrete benchmark on consumer-tier DGX Spark hardware. Comparisons across reasoning-on and reasoning-off settings make it easy to judge whether enabling reasoning is worth the latency.
用中子仪器设计测智能体会不会物理,7个模型最多做对7/16题,RL把Qwen3-8B从11%练到77%,比32B还强。
The counterintuitive idea is that the literature, not runtime traces, is the highest-value source of harness improvements. Builders tuning agent scaffolds around a fixed model can replicate the module-and-topic-modeling loop with their own paper corpus instead of paying for a model upgrade. Results on AppWorld Challenge and Tau2-Bench Telecom give a concrete baseline for comparing it against failure-log-driven harness tuning.
The approach addresses a fundamental limitation in current RL methods where all trajectory tokens receive equal credit, making it impossible to identify decisive steps. Developers working on agent systems can implement this method to improve training efficiency, particularly when using smaller judge models, potentially reducing computational costs while maintaining performance gains.
This research significantly reduces the computational cost of implementing MTP heads, making advanced inference optimization more accessible. The findings could enable faster deployment of large language models without requiring massive pretraining resources. Developers and researchers working on model optimization can implement these techniques to improve throughput with minimal computational overhead.
SCAPO算法通过半事实稳定性改进了令牌级信用分配,在数学和分布外基准上表现优异。
This research addresses a critical gap in VLM distillation where students can match teacher outputs without relying on the same visual evidence. The CW-OPD method provides a corrective signal that makes visual evidence reliance explicit rather than implicit. Developers working with smaller models can leverage this approach to achieve performance comparable to much larger models while maintaining better visual grounding.
ACSD provides a novel approach to token-level supervision throughout long responses by leveraging activation contrasts, offering a more stable alternative to existing methods. Researchers and developers working on reasoning models can implement this technique to improve mathematical accuracy without requiring reference solutions, potentially enhancing model performance across diverse training datasets.
The research challenges the universal compression explanation for post-training effects, revealing instead two distinct regimes affecting mathematical reasoning differently. For AI practitioners and researchers working on mathematical reasoning models, this provides nuanced insights into training approaches and their impact on problem-solving capabilities across difficulty levels and languages.
This benchmark reveals critical limitations in current AI models' understanding of stateful systems, showing they struggle to track intervention effects without continuous correct feedback. Developers building coding assistants should note that models make compounding errors over time, highlighting the need for robust error handling and state management in AI systems.
This research challenges the assumption that expensive verification systems are necessary for effective LLM training. Developers and researchers can now confidently use more affordable verification options without compromising training quality, potentially reducing costs for AI model development. The findings particularly benefit organizations working with resource constraints or those deploying models in cost-sensitive environments.
ScopeIF addresses a critical gap in LLM training by providing dense supervision for complex constraints that existing binary reward models miss. This approach significantly improves performance on multi-faceted instructions without compromising general capabilities. Developers working with complex task automation can implement this framework to enhance their models' precision, particularly when dealing with segmented constraints across different response parts.
The composition gap reveals a fundamental limitation in how LLMs combine correct intermediate steps into final answers, even when all components are provided. Developers and researchers can use OracleLadder to diagnose specific reasoning failures in their models, with the released code and data enabling reproducible testing across different problem domains.
这篇论文用 gsm_hard 上的 120 题实验算清了一笔账:流水线出错后,把原题重新喂给第一个下游阶段就能挽回 0.394,每题只多花 59.8 个 token,后面的阶段白搭。
合并 MoE 模型时看到路由乱了先别急着修,这篇用 DeepSeekMoE 等三个模型证明漂移不等于失败,还给了工具包和修复代码。
训练智能体 RL 的人可以看看:PEARL 动态调 prefill-decode 配置还能借闲置 GPU,吞吐比 RLBoost+ 最高多 36.3%。
Qwen3.5-4B 只靠写复盘解释做微调,不用奖励模型就在 SWE-bench 上跑赢 GRPO,做智能体训练的可以看看这套 ROFT 流程。
一篇很实用的论文:让大模型和小模型在任务里分工干活,成本砍到一半性能反升,ALFWorld 上省了八成推理开销。
A more-than-doubling of accuracy on a widely used 8B open model suggests the training recipe, not just model scale, drives reasoning gains. Researchers fine-tuning smaller open models can test DCE + SRCL against OPSD as a cheaper distillation path. Qwen3-8B's popularity in ASEAN developer communities makes the recipe directly reproducible with local hardware.
NVIDIA 把社区写的 3.4k 个 Agent Skills 直接变成 RL 训练环境,300 步就把 Qwen 27B 在 Terminal-Bench 上拉高近 5 个点,流水线和负结果都写得很细,做 agent 训练的值得看看仓库。
这篇 arXiv 论文拿三个 32B 模型做了思考前后对比,发现思考反而制造约 5 倍的新偏见翻转,做公平性评估的人该看看。
Continual training on distilled skills outperforming a larger-context approach suggests skill libraries can be baked into weights rather than retrieved at inference time. Teams building terminal or coding agents can test whether the same recipe transfers to their own models and checkers. The result also matters for anyone benchmarking open-weight Qwen models against Claude Sonnet 4.6 and GPT-5.4 Mini on agentic tasks.