大企业内部AI使用真实数据,揭示高级员工如何更聪明地使用AI,以及培训效果有限。
研究分析了2025年一家大型企业近4,000名后台员工的713,564个提示词及对应回复。高级员工展现出更复杂的AI使用模式,与专业知识互补。不同部门使用复杂度差异显著,战略、数字化创新和项目管理部门最高。研究未发现使用复杂度随时间提升或正式AI培训后持续改善的现象。
Sophistication in GenAI Use: Field Evidence from a Large Firm
We study how sophistication in generative AI (genAI) use varies among the back-office workforce of a large firm. Using proprietary data, we observe 713,564 employee prompts and their corresponding large language model responses from nearly 4,000 back-office employees across 15 functional areas over eight months in 2025. We document three main findings. First, senior employees exhibit more sophisticated genAI use, consistent with domain expertise complementing genAI capabilities. Second, sophistication varies considerably across functions and is highest in Strategy, Digital Innovation, and Project Management, three groups that share a focus on firmwide strategic initiatives and organizational change. Third, we observe neither improvements in sophistication over time nor lasting improvements following formal AI training, suggesting that sophisticated use can be difficult to change. Together, our study provides measures of and insights into sophisticated genAI use that managers can use to improve outcomes and that researchers can use in future research.