论文

RSI-Router:子任务级大模型路由框架,推理成本降至约一半

RSI-Router: Evolving Subtask-Level LLM Routing and Skills for Cost-Efficient Agents

精选理由

一篇很实用的论文:让大模型和小模型在任务里分工干活,成本砍到一半性能反升,ALFWorld 上省了八成推理开销。

论文提出 RSI-router,通过递归自我改进在子任务层面分配大小模型并演化模型专属技能。在 DeepSeek-V4.1-Flash 与 Qwen3.5-9B 之间的路由实验中,整体推理成本为 DeepSeek 单模型基线的 48.3%。在 ALFWorld、ScienceWorld、WebShop 三个基准上,成本削减 74.7%-82.2% 且性能还有提升;在 Terminal-Bench 2.0 上以低 18.0% 的成本取得 16.7% 的相对性能增益,性能-成本 Pareto 前沿优于 9 种路由方法。

原文 · arXiv: DeepSeek

RSI-Router: Evolving Subtask-Level LLM Routing and Skills for Cost-Efficient Agents

Practical deployment of large language model (LLM) agents requires strong task performance at affordable inference cost. For long-horizon agentic tasks, this performance-cost trade-off can be improved through within-task large-small model collaboration, as smaller models can handle some stages even when they cannot solve the full task. In this paper, we introduce RSI-router, a routing framework that constructs subtask-level model assignments and model-specific skills through recursive self-improvement over accumulated experience. Each iteration consists of four stages: Subtask Mining derives subtask definitions and identification rules from training trajectories; Routing Strategy Evolution proposes and evaluates diverse model assignments; Model-Specific Skill Evolution compares routed and large-model-only trajectories to diagnose failures and develop reusable execution skills; and Pareto-Optimal Router Selection updates the Pareto population using historical and newly generated routers while retaining dominated routers as experience for subsequent evolution. Routing between DeepSeek-V4.1-Flash and Qwen3.5-9B, RSI-router consistently surpasses the DeepSeek-only baseline at roughly half the inference cost (48.3%) across five agentic benchmarks. In particular, on ALFWorld, ScienceWorld, and WebShop, it cuts inference cost by 74.7-82.2% while simultaneously improving performance; on Terminal-Bench 2.0, it achieves a 16.7% relative performance gain at 18.0% lower cost. Moreover, RSI-router establishes a stronger performance--cost Pareto frontier than 9 routing methods.