Multi-Teacher Self-Distillation Policy Optimization
MT-SDPO improves multi-domain LLM performance by 14.79 points on Qwen3-8B, offering better domain balance than single-teacher approaches.
MT-SDPO improves multi-domain LLM performance by 14.79 points on Qwen3-8B, offering better domain balance than single-teacher approaches.