这项研究戳破了AI编码效率的泡沫,做AI工具或依赖AI编程的团队看完会重新评估投入产出比——代码量翻倍不等于交付翻倍,值得所有技术管理者点开。
MIT一项新研究发现,AI编码工具虽然大幅提升了代码提交量(自主智能体提升180%),但实际软件发布量仅增加30%。研究分析了超过10万名GitHub开发者使用三代AI工具(自动补全、交互式、自主智能体)的数据,发现代码量与产出之间存在巨大鸿沟。核心原因在于软件开发中存在多个薄弱环节:人类仍需负责需求决策、代码审查、系统集成、边缘情况修复和最终发布。应用市场数据也显示,新应用数量增加但总使用量未上升,表明用户并未更多采用这些新软件。
源:https://t.co/L6vg5vBQSz
源: x.com/rohanpaul_ai/s… Rohan Paul @rohanpaul_ai New MIT study. Code volume surges by 300%, but output increases by only 30%: The AI dividend meets an awkward reality Autonomous AI coding agents raised commits by 180%, but releases rose only 30%. The paper’s main idea is that software production has weak links, so faster code writing does not help as much when humans still need to review, connect, test, package, and ship the work. The authors also check app marketplaces and find more new apps, but no increase in total usage, which means more software appeared without clear evidence that users adopted more software. The marketplace evidence points the same way: more new apps appeared, but total usage did not rise. The authors compare more than 100,000 GitHub developers before and after they start using 3 generations of AI coding tools, from autocomplete to more independent coding agents. Autocomplete raised commits by 40%, interactive coding agents raised them by 140%, and autonomous coding agents raised them by 180%. The 180% commit gain shrank to 50% for the number of projects and 30% for actual releases. The estimated "elasticity of substitution" is 0.25 i.e. for every big improvement in AI’s usefulness, only a small amount of human work can be replaced. Because AI can write code faster, but humans are still needed to decide what to build, check if the code works, connect it with the rest of the product, fix messy edge cases, and actually ship it. --- papers .ssrn.com/sol3/papers.cfm?abstract_id=6859839 🔗 View Quoted Tweet 💬 0 🔄 0 ❤️ 0 👀 695 ⚡