AI 写代码到底靠不靠谱？这篇论文用数据说话——重构 PR 质量有提升也有隐患，做 AI 编程工具或代码审查的团队值得看看，能帮你设计更好的质量门控。
一项针对 AI 代理生成的 Python 重构 Pull Request 的实证研究发现，平均 22.5% 的变更提升了代码质量属性，其中可用性提升最频繁（36.5%）。但 24.17% 的修改文件引入了新的 Pylint 问题（主要是约定违规如长行），4.7% 引入了新的 Bandit 安全发现。尽管存在这些问题，73.5% 的 PR 被合并，包括那些引入新问题但同时也移除了旧问题的案例。研究还归纳了 24 种常见变更操作及其与 lint/安全发现的关系，强调了在 AI 驱动开发中加强质量与安全门控的必要性。
Quality and Security Signals in AI-Generated Python Refactoring Pull Requests
As AI agents increasingly contribute to code development and maintenance, there is still limited empirical evidence on the quality and risk characteristics of their changes in real-world projects, particularly for refactoring-oriented contributions. It remains unclear how agent-authored refactoring edits affect maintainability, code quality, and security once merged into GitHub repositories. To address this gap, we conduct an empirical study of Python refactoring pull requests (PRs) from the AIDev dataset. We analyze agentic refactoring PRs using PyQu, an ML-based quality assessment tool for Python, to quantify changes across five quality attributes, and we complement PyQu with domain-independent static analysis (Pylint and Bandit) to measure code quality and security issues before and after each change. Our results show that, on average, agentic commits improve a quality attribute in 22.5% of the studied changes, with usability improving most frequently (36.5%). At the same time, 24.17% of modified files introduce new Pylint issues predominantly convention level violations such as long lines-while 4.7% introduce new Bandit findings. From the observed diffs, we derive a taxonomy of 24 recurring change operations and map them to the lint and security findings they most commonly affect. Despite these mixed outcomes, developer acceptance is high: 73.5% of the analyzed PRs are merged, including cases that introduce new lint or security findings, often alongside the removal of existing issues. Overall, these findings highlight both the promise and current limitations of agentic refactoring, and motivate stronger tool-in-the-loop quality and security gating for AI-driven development workflows.