论文精选

微软2026年早期推广Claude Code与Copilot CLI效果研究

Adoption and Impact of Command-Line AI Coding Agents: A Study of Microsoft's Early 2026 Rollout of Claude Code and GitHub Copilot CLI

精选理由

想知道哪些工程师会长期用Claude Code和Copilot CLI吗?微软内部数万人实测告诉你:用的人都多合了24%的PR,而且全靠同事带动。

AI 摘要

微软在2026年初向数万名工程师推广了Claude Code和GitHub Copilot CLI。研究发现首次使用主要通过社交网络扩散,留存与工程师的编码活动频率相关而非人口统计因素。采用者合并的Pull Request数量比以往约多24%,该提升在四个月的观察窗口内持续存在。这些结果基于微软内部的实际部署数据,表明命令行AI编码代理并非短期新奇效应。

原文 · arXiv: Anthropic

Adoption and Impact of Command-Line AI Coding Agents: A Study of Microsoft's Early 2026 Rollout of Claude Code and GitHub Copilot CLI

Organizations rolling out agentic command line tools like Anthropic's Claude Code and GitHub's Copilot CLI need to know who will try them, who will keep using them, and whether the tools produce enough output to justify their cost. At organizational scale, token spend can run into millions of dollars annually, so misreading adoption, retention, or impact can make a rollout expensive without changing engineering velocity. Studying tens of thousands of engineers at Microsoft over its early-2026 rollout, we find that first use spread primarily through social networks, retention was associated more with engineers' coding activity than with demographics, and adopters merged roughly 24% more pull requests than they would have otherwise. We use merged pull requests as our proxy for output -- acknowledging that a merged PR is not the same as the value it delivers -- and the lift persists across our four-month window. These results suggest that CLI coding agents are neither uniformly adopted nor mere novelty effects and that organizations should treat visible peer use as central to rollout strategy.

微软2026年早期推广Claude Code与Copilot CLI效果研究 · AI 热点