Latest

Every published item, in order · 325 items
10月6日
PapersBuildersMulti-sourceSelected06:46
Shanghai AI Laboratory SkillGym trains better agents from verified skill runs

Training on verified execution traces can bake retrieval-dependent prompt skills into model weights, reducing reliance on the agent finding and following instructions at runtime. Teams building coding agents can replicate the recipe by turning their own skill libraries into checkable sandbox tasks. The work comes from a Chinese lab and benchmarks on Claude Code with Qwen, making it a useful reference point against prompt-based skill systems like Claude Skills.

Event
rohanpaul_ai@rohanpaul_ai3 sourcesSource
PapersUS vs ChinaMulti-sourceSelected01:04
Qwen3.8 27B addition in words tested on DGX Spark

A 27B open-weights model running locally now solves multi-digit addition-in-words at near-perfect accuracy, a task GPT-4o fumbled two years ago. Practitioners evaluating small local models for arithmetic-adjacent workflows get a concrete benchmark on consumer-tier DGX Spark hardware. Comparisons across reasoning-on and reasoning-off settings make it easy to judge whether enabling reasoning is worth the latency.

Event
官方账号Simon Willison’s Weblog3 sourcesSource
10月5日
10月4日
PapersBuildersSelected15:21
Microsoft paper ScholarEvolve evolves agent harnesses from research papers

The counterintuitive idea is that the literature, not runtime traces, is the highest-value source of harness improvements. Builders tuning agent scaffolds around a fixed model can replicate the module-and-topic-modeling loop with their own paper corpus instead of paying for a model upgrade. Results on AppWorld Challenge and Tau2-Bench Telecom give a concrete baseline for comparing it against failure-log-driven harness tuning.

elvis@omarsar0Source
10月2日
PapersBuildersMulti-sourceSelected16:15
ProVer method for agent RL credit assignment

The approach addresses a fundamental limitation in current RL methods where all trajectory tokens receive equal credit, making it impossible to identify decisive steps. Developers working on agent systems can implement this method to improve training efficiency, particularly when using smaller judge models, potentially reducing computational costs while maintaining performance gains.

Event
elvis@omarsar03 sourcesSource
PapersBuildersSelected10:41
Multi-Token Prediction Heads Research

This research significantly reduces the computational cost of implementing MTP heads, making advanced inference optimization more accessible. The findings could enable faster deployment of large language models without requiring massive pretraining resources. Developers and researchers working on model optimization can implement these techniques to improve throughput with minimal computational overhead.

arXiv: DeepSeek@Prachi Badarayani et al. (11)Source
10月1日
PapersBuildersSelected09:58
Cross-World On-Policy Distillation for VLMs

This research addresses a critical gap in VLM distillation where students can match teacher outputs without relying on the same visual evidence. The CW-OPD method provides a corrective signal that makes visual evidence reliance explicit rather than implicit. Developers working with smaller models can leverage this approach to achieve performance comparable to much larger models while maintaining better visual grounding.

arXiv: DeepSeek@Yuanhao Sun et al. (5)Source
PapersBuildersSelected09:55
Activation-Conditioned Self-Distillation

ACSD provides a novel approach to token-level supervision throughout long responses by leveraging activation contrasts, offering a more stable alternative to existing methods. Researchers and developers working on reasoning models can implement this technique to improve mathematical accuracy without requiring reference solutions, potentially enhancing model performance across diverse training datasets.

arXiv: DeepSeek@Zhexi Lu et al. (5)Source
9月30日
PapersBuildersSelected10:43
Post-Training Effects on Mathematical Reasoning

The research challenges the universal compression explanation for post-training effects, revealing instead two distinct regimes affecting mathematical reasoning differently. For AI practitioners and researchers working on mathematical reasoning models, this provides nuanced insights into training approaches and their impact on problem-solving capabilities across difficulty levels and languages.

arXiv: DeepSeek@Hongyang Li et al. (6)Source
PapersBuildersSelected09:37
CTE-Bench for Stateful Software Simulators

This benchmark reveals critical limitations in current AI models' understanding of stateful systems, showing they struggle to track intervention effects without continuous correct feedback. Developers building coding assistants should note that models make compounding errors over time, highlighting the need for robust error handling and state management in AI systems.

Event
arXiv: DeepSeek@Xinran Zhang2 sourcesSource
9月29日
PapersBuildersSelected20:37
LLM Post-training Robust to Erroneous Rewards

This research challenges the assumption that expensive verification systems are necessary for effective LLM training. Developers and researchers can now confidently use more affordable verification options without compromising training quality, potentially reducing costs for AI model development. The findings particularly benefit organizations working with resource constraints or those deploying models in cost-sensitive environments.

Tanishq Abraham (论文推介)@iScienceLuvrSource
PapersBuildersSelected18:34
ScopeIF Framework for LLM Instruction Following

ScopeIF addresses a critical gap in LLM training by providing dense supervision for complex constraints that existing binary reward models miss. This approach significantly improves performance on multi-faceted instructions without compromising general capabilities. Developers working with complex task automation can implement this framework to enhance their models' precision, particularly when dealing with segmented constraints across different response parts.

arXiv: DeepSeek@Bosi Wen et al. (6)Source
PapersBuildersSelected18:33
OracleLadder Reveals Math Reasoning Gap

The composition gap reveals a fundamental limitation in how LLMs combine correct intermediate steps into final answers, even when all components are provided. Developers and researchers can use OracleLadder to diagnose specific reasoning failures in their models, with the released code and data enabling reproducible testing across different problem domains.

arXiv: DeepSeek@Zhuohan Wang et al. (6)Source
9月28日
PapersBuildersSelected12:01
Meta proposes DCE + SRCL outperforming OPSD on Qwen3-8B

A more-than-doubling of accuracy on a widely used 8B open model suggests the training recipe, not just model scale, drives reasoning gains. Researchers fine-tuning smaller open models can test DCE + SRCL against OPSD as a cheaper distillation path. Qwen3-8B's popularity in ASEAN developer communities makes the recipe directly reproducible with local hardware.

Aran Komatsuzaki (论文推介)@arankomatsuzakiSource
PapersBuildersMulti-sourceSelected73°06:39
SkillGym trains Qwen3.5-35B-A3B on 2,756 skill environments

Continual training on distilled skills outperforming a larger-context approach suggests skill libraries can be baked into weights rather than retrieved at inference time. Teams building terminal or coding agents can test whether the same recipe transfers to their own models and checkers. The result also matters for anyone benchmarking open-weight Qwen models against Claude Sonnet 4.6 and GPT-5.4 Mini on agentic tasks.

Event
DAIR.AI@dair_ai3 sourcesSource