Papers

OmniSimulator:用结构化行为推理框架训练小模型模拟短视频用户行为

OmniSimulator: Aligning Small Language Models for Authentic Heterogeneous Behavior Modeling

Why we picked it

有人把 Qwen3-8B 调教成短视频用户行为模拟器,提分 34% 后追平 Claude-Sonnet-4.5,8B 就能自己部署,做用户模拟的可以看看这篇。

论文提出 OmniSimulator,一个面向短视频平台场景的用户模拟训练框架,通过五维结构化 schema 组织行为推理,并引入教师模型生成高质量推理轨迹。训练数据来自 200 名真实用户三个月的历史交互轨迹,构建出 9,881 条训练实例,人均约 50 条蒸馏样本。实验显示该框架将 Qwen3-8B 的平均分提升 34.33%,成绩与 Claude-Sonnet-4.5 相当,且支持小规模自托管部署。

Original · arXiv cs.AI

OmniSimulator: Aligning Small Language Models for Authentic Heterogeneous Behavior Modeling

Large language models (LLMs) have shown great potential as general-purpose user simulators for interactive systems. Prior studies have demonstrated that training on high-quality data can substantially improve model reasoning and downstream task performance. However, the upper bound of user simulation is still constrained by the model's reasoning paradigm: native chain-of-thought often degenerates into shallow pattern matching and fails to adequately model the behavioral factors underlying real user decisions. In this paper, we propose OmniSimulator, a novel training framework designed to improve the predictive ability of small LLMs for realistic user simulation on short-video platform environments. Specifically, OmniSimulator organizes behavior-oriented reasoning through a structured schema with five dimensions, carefully selects data from real user-behavior scenarios, and introduces a teacher model to generate high-quality reasoning traces under the proposed schema, helping small models learn behavior-relevant reasoning patterns rather than relying on superficial behavioral correlations. Based on this process, we construct 9,881 high-quality training instances from three months of historical interaction trajectories of 200 real users, averaging about 50 distilled examples per user. Experimental results show that OmniSimulator improves the average score of Qwen3-8B by 34.33%, achieves performance competitive with Claude-Sonnet-4.5, and supports smaller-scale, self-hosted deployment. These results suggest that learning structured behavior-oriented reasoning patterns is a promising direction towards scalable and high-fidelity LLM-based user simulation.