The benchmark shows that outcome-only evaluation masks invalid execution, since models can hit the final goal while violating constraints mid-run — a gap that matters most in regulated domains like payments where intermediate errors carry financial or compliance consequences. Agent builders can use the 50-task suite and deterministic checks to measure constraint compliance and tool-call overhead, not just task success. Teams choosing models for workflow automation get a direct comparison of frontier and open models under identical conditions.
Latest
The method requires no new environment interactions, so teams can layer it onto existing reward setups without extra rollout cost. Researchers and engineers training coding agents on sparse test-based rewards get a concrete fix for zero-variance groups, with the bounded-reward design showing how to keep self-judgement from overriding ground-truth correctness. It compares against standard GRPO-style binary reward training on Qwen3-14B.
把强智能体蒸馏进小模型的新方法,不要求师生同族模型,Qwen3-4B 实测涨 3.3-6.9 个点,做 agent 压缩的可以看看。
用中医辨证基准证明了件事:很多模型翻车不是能力不够,是输出纪律不行。他们设计的证伪协议能把 Kimi K3 的方差从 0.218 压到 0.007,写智能体的值得看看。
做幻灯片、海报生成的朋友看看这篇:代码模型配上参考图做 RL,8B 小模型的视觉分数追上了 GPT-5.5,方法拆得很细。
新论文 LAGO:把成功子任务存成可复用选项库,不改权重跨任务变强,SWE-bench 上跑赢 mini-SWE-agent 和 Terminus 2。
这批研究者把 Qwen3 的推理过程微调成文言文,更省 token、漏答更少,还压过了同样压缩过的白话版。
Teams burning GPU-hours on OOM crashes and suboptimal parallelism recipes can instead score candidate configurations in seconds on one machine, then commit only to the promising ones. The paper's validated error rates at production scale — including on DeepSeek V3 and Qwen3 — make the projections credible for real deployments. Engineers planning training runs on 256 to 1,024 GPU clusters, or on hardware not yet available, get a practical tuning workflow they can adopt directly.
给视频模型换个练法:不背字幕改练事件排序,GRPO 免人工标注,Qwen3-VL 上实测有效。
The key insight is that environment design itself can be automated and fed back into the RL loop, with solver rollouts guiding each new round — and gains collapse when the proposer cannot see that feedback. Teams training RL agents can use this to cut the cost of building valid environments, comparing frontier proposers like GPT-5.6-sol against Claude Opus 5 on the same task.
做剪枝的可以看看:CACTUS 比 LLM-Surgeon 快 28 倍,还能保留影响函数做数据选择。
给文本批量打标签太贵?SLKR 让旗舰模型离线写好标签规则,Qwen3.5-4B 一次调用就能分类。
Anthropic 把模型拆到 15 台电视盒子上跑,还测了模型自己复制自己,结果和瓶颈都讲得很细,做安全的应该看看。
免训练就能让 Qwen3.5-35B-A3B 看小时级长视频,三个基准最高涨近 13 个点,推理时直接插上就能用。
Anthropic 红队真刀真枪测了 AI 蠕虫,只有 GLM-5.2 能自己传遍 8 台服务器,还买了 15 台电视盒子拆着跑模型,细节很扎实。
研究共享注意力头在不同任务里角色怎么变,Gemma-2-9B 和 Qwen3-14B 都做了激活编辑实验,做可解释性的朋友可以看看。
训练智能体只在终点给反馈、中间决策没法打分?这篇 MCGPO 直接复用已有轨迹做加权偏好,Qwen3-8B 在 WebShop 上提了 5 个点,还不额外加 critic。
The core insight is that evaluation harnesses create a train-deploy mismatch: models trained to emit one static query underperform when deployed agents must probe schemas and revise queries interactively. Teams building agentic SQL or tool-use systems should consider matching training and inference environments rather than adding capabilities at fine-tuning time. The method uses open Qwen models, so results are reproducible without proprietary systems.
The actionable shift is diagnostic: the same failure mode responds to different interventions, so prompt and tooling edits can waste effort on problems only weight training solves. Teams building agents can use the process-versus-content taxonomy as a triage step before committing compute. The Qwen3.5 LoRA numbers give a concrete baseline for how much fine-tuning moves plan quality on a small model.
The non-obvious idea is that multi-agent self-supervision can replace the external verifier that most self-improvement loops depend on, extending the approach to open-ended tasks with no ground-truth checker. Researchers working on self-improving agents and efficient training should read the paper and the accompanying Chat with Paper walkthrough to see whether the workflow-search setup transfers to their own models.
This research reveals that quality trumps quantity in skill distillation, potentially reducing computational costs by over 90% while maintaining performance. For developers and researchers working with large language models, this method offers a practical way to optimize training efficiency and improve model performance on specific tasks like math contests.
论文教你看 agent 失败原因来决定改运行时框架还是微调模型,Qwen3.5 上从 0.16 拉到 0.30,做 agent 的都该看看这套诊断方法。
一篇 MoE 训练论文:把固定 top-k 换成在 k 附近随机采样,Qwen3-30B-A3B 微调能多拿 2 分,推理成本不变。
Plain-chat safety evals can overstate how safe an agentic system actually is, since tool use measurably erodes refusal behaviour across every model tested. Teams building multimodal agents should benchmark safety with tools attached and consider re-inserting the original request before generation. The paper is on arXiv with a chat interface at academy.dair.ai for quicker exploration.
给 TTS 加了个情绪旋钮,不用重新训练模型,注入转向向量就能调情绪强度,Qwen3-TTS 上效果最高提升 7 倍。
这篇论文把 RAG 从'检索'升级成'主动算证据',RouterLM 用 Qwen3.5-9B 就打赢了 Gemini 3.5 Flash,做 RAG 的可以看看思路。
有人发现给基础模型加一句"Okay"开头,Olmo-3-7B 在 MATH-500 就从 42% 涨到 78%,原理分析也很有意思。
不用 RL 训练,只在开头加个 "Okay" 就能让 Olmo-3-7B 数学成绩翻近一倍,这篇论文把原因挖得很透,做模型训练的值得看看。
给医学问答做了个按问题动态分配 LoRA 秩的微调方法,在 Qwen3-8B 上比 LoRA r16 高了 1 个多百分点,专科越多优势越大,做医疗方向微调的可以看看。
有人测了 TypeSafe 那个号称便宜快的 JEV,结果在 OpenAI 批量价格下根本不省钱,校准也没明显赢 Qwen3.8-27B,想做文本标注的可以看看。
GUI 智能体缺训练数据的老问题,这篇用图像编辑模型自己造数据,Qwen3-VL 微调后 AndroidWorld 成绩还涨了不少,代码开源可以直接试。
孟加拉语这种低资源语言上,Llama 4 Maverick 不微调就拿下 0.931 的 F1,比 BanglaBERT+XGBoost 还高,做低资源语言分类的可以看看。