#SWE-OPD

1 stories · 1 in 7 days · 1 in 30 days
Stories, products and papers tagged "SWE-OPD", newest first.
Nov 17
PapersBuildersSelected16:05
SWE-OPD distills agentic coding from teacher into smaller models

The finding that cached, offline teacher scores work nearly as well as on-policy ones makes agentic distillation affordable for teams without large training clusters, cutting GPU-hours by well over half. Teams fine-tuning small coding agents should treat falling reverse-KL loss with suspicion and watch for repetition rather than trusting the loss curve alone. The demonstrated cross-tokenizer transfer between DeepSeek and GLM checkpoints matters for builders mixing open-source model families in agentic coding pipelines.

arXiv: DeepSeek@Yuhang He et al. (14)Source