这篇论文教你让AI写代码时自己能判断靠不靠谱，比之前的ChatDev更稳，特别适合做复杂软件项目。
UA-ChatDev是一个基于不确定性感知的多智能体软件开发框架，用于解决多智能体协作中幻觉传播问题。它通过token级对数概率评估智能体响应置信度，并采用阶段感知阈值校准，在不确定性过高时触发检索验证。在SRDD基准测试中，UA-ChatDev在完整性、可执行性、一致性和整体质量指标上全面超越单智能体和多智能体基线。消融实验和通信分析表明，不确定性感知机制有效提升了代码执行可靠性。
UA-ChatDev: Uncertainty-Aware Multi-Agent Collaboration for Reliable Software Development
Software development is a complex task that demands cooperation among agents with diverse roles. Large language models (LLMs) have enabled autonomous multi-agent software development frameworks that leverage role-based collaboration to automate requirements analysis, coding, testing, and refinement. However, existing approaches typically assume that intermediate agent outputs are equally reliable, leaving them vulnerable to hallucination propagation, where incorrect decisions generated in early development phases are transferred to downstream agents and negatively impact final software quality. To address this challenge, we propose UA-ChatDev, an uncertainty-aware multi-agent software development framework that integrates uncertainty quantification into agent interactions. It introduces a lightweight uncertainty estimation mechanism based on token-level log probabilities to assess the confidence of agent responses and employs phase-aware threshold calibration to selectively trigger retrieval-based verification when uncertainty exceeds acceptable levels. Extensive experiments on the SRDD benchmark demonstrate that UA-ChatDev consistently outperforms existing single-agent and multi-agent software development frameworks across completeness, executability, consistency, and overall quality metrics. Further ablation studies and communication analyses verify that uncertainty-aware interactions enhance code execution reliability.