做多智能体系统或推理管线的开发者,StreamMA 用流式通信同时解决了延迟和效果问题,值得直接参考实现思路。
多智能体推理系统通常采用“先生成再传输”的范式,导致端到端延迟随流水线深度线性增长。StreamMA 提出流式方案,每个推理步骤生成后立即流式传输给下游智能体,实现流水线并行,显著降低延迟。令人意外的是,这种流水线还提升了效果:因为多步推理质量不均匀,早期步骤更可靠,使用早期步骤而非完整链条可防止错误后期步骤误导下游智能体。在数学、科学和代码等八个推理基准上,StreamMA 平均提升 7.3 个百分点,最高提升 22.4 个百分点。研究还发现了“步骤级缩放定律”:增加每个智能体的步骤数能同时提升效果和效率,这是一个与智能体数量缩放正交的新维度。
Streaming Communication in Multi-Agent Reasoning
Multi-agent reasoning systems adopt a "generate-then-transfer" paradigm that forces end-to-end latency to scale linearly with pipeline depth. We introduce StreamMA, a multi-agent reasoning system that streams each reasoning step to downstream agents as soon as it is generated, pipelining adjacent agents and thus reducing latency. Surprisingly, this pipelining also improves effectiveness: because multi-step reasoning quality is non-uniform and early steps are more reliable than later ones, working with these reliable early steps instead of the full chain prevents error-prone late steps from misleading downstream agents. We formalize both advantages with the first closed-form joint analysis of stream, serial, and single protocols, deriving the effectiveness ordering, speedup upper bound, and cost ratio. Across eight reasoning benchmarks spanning mathematics, science, and code, two frontier LLMs (Claude Opus 4.6 and GPT-5.4), and three topologies (Chain, Tree, Graph), StreamMA outperforms both baselines (avg. +7.3 pp, max +22.4 pp on HMMT 2026; Claude Opus 4.6-high). Beyond these contributions, we discover a "step-level scaling law": increasing per-agent steps consistently improves both effectiveness and efficiency, a new scaling dimension orthogonal to and composable with agent-count scaling.