CONSTRAINTDIAL:通过协议变异构建智能合约安全评测任务
Beyond Copying: Lifelong Smart Contract Security Task Construction via Protocol Mutation
做 Web3 安全评测的可以看看:这套路子用协议变异生成新任务,照抄链上公开攻击代码没用,3035 个任务还覆盖检测到修补全流程。
一篇 arXiv 论文提出 CONSTRAINTDIAL 框架,用协议变异方式持续生成智能合约安全任务,避免评测被公开答案“背题”污染。框架自动在本地重建合约,并通过攻击执行来调整所需调用或输入,让原始攻击在新任务上失效。SlowMist 统计区块链生态损失约 386 亿美元,凸显安全评测需求。团队从 203 个公开案例构建了 3,045 个任务输入,覆盖检测、利用和修补三类。协议变异使带公开答案的任务成功率平均下降 10.9 个百分点,直接照搬网上答案即可解出的任务比例下降 9.3 个百分点。
Beyond Copying: Lifelong Smart Contract Security Task Construction via Protocol Mutation
AI agents can inspect code and run tests to support smart contract security. SlowMist reports about $38.6 billion in losses across the broader blockchain ecosystem. Existing evaluations can reward memorized or copied answers, including attack code recovered from public blockchain transactions. Reconstructing contracts and validating tasks also require costly manual effort. To address these issues, we propose CONSTRAINTDIAL, a framework for lifelong construction of smart contract security tasks via protocol mutation. It automates local contract reconstruction and uses attack execution to select changes to the required calls or inputs. Execution checks guide revisions that make the original attack fail while preserving exploitability, the security objective, and normal functionality. New incidents and audit findings enter the same procedure. With CONSTRAINTDIAL, we construct 3,045 task inputs from 203 public cases, covering detect, exploit, and patch. Compared with reconstruction alone, protocol mutation reduces success with supplied public answers by 10.9 percentage points on average across detect, exploit, and patch. The fraction of tasks solved by copying online answers falls by 9.3 points.