这篇论文通过实验分析了跨智能体规范可移植性,对多智能体软件工程中的规范可移植性、智能体特定解释和基于检索的访问提供了有价值的见解。
本文通过Oracle到PostgreSQL迁移实验,评估了跨智能体规范可移植性。实验分为两个阶段,第一阶段在1,006个PL/SQL文件上进行了规范优先迁移管道评估,第二阶段在1,802个Oracle脚本上使用Amazon Kiro、Google Gemini、GitHub Copilot、Claude Code和Cursor进行了跨智能体实验。评估指标包括Token F1、精确匹配、SQL语法有效性、AST精确匹配、AST平均相似度和即时可运行性。结果表明,规范大小并不能预测实现质量,跨智能体迁移可能导致显著的智能体依赖性退化。重写显著提高了Gemini的表现,压缩并未提供普遍益处,检索增强的摄入是Gemini和Copilot在各自智能体Pareto前沿上的唯一共同策略。研究结果表明,在异构SDD工作流程中,规范不应被视为智能体无关的工件,并激励了对规范可移植性、智能体特定解释和基于检索的访问在多智能体软件工程中的显式考虑。
Specification Portability Across LLM Development Agents: Cross-Agent Compatibility in Specification-Driven Software Migration
This paper investigates cross-agent specification portability using Oracle-to-PostgreSQL migration as a controlled software transformation task. The study combines two experimental stages. First, a specification-first migration pipeline was evaluated on 1,006 PL/SQL files, of which 623 were successfully regenerated and 380 generated scripts executed successfully in PostgreSQL 16. Second, cross-agent experiments were conducted on a dataset of 1,802 Oracle scripts with corresponding PostgreSQL implementations using Amazon Kiro, Google Gemini, and GitHub Copilot, with Claude Code and Cursor included in the initial single-agent evaluation. Native and foreign specifications were assessed using Token F1, exact match, SQL syntax validity, AST exact match, AST mean similarity, and immediate runnability. The results show that specification size alone does not predict implementation quality and that cross-agent transfer can produce substantial agent-dependent degradation. The strongest replicated case occurred when Gemini directly consumed a Kiro-origin specification, producing a Token F1 of 0.035, SQL syntax validity of 2.33%, and AST mean similarity of 0.015. Rewriting substantially improved Gemini in the tested configuration, compression did not provide a universal benefit, and retrieval-augmented ingestion was the only common strategy represented on the per-agent Pareto frontiers of both Gemini and Copilot. The findings suggest that specifications in heterogeneous SDD workflows should not automatically be treated as agent-neutral artifacts and motivate explicit consideration of specification portability, agent-specific interpretation, and retrieval-based access in multi-agent software engineering.