Claude Opus 4.7居然能自动给MPI软件加上检查点恢复,50分钟搞定,效果媲美人工,HPC开发者可以解放双手了。
Anthropic的Claude Opus 4.7通过OpenCode CLI驱动迭代代码生成,平均50分钟为一个MPI科学应用生成检查点/重启代码。每个应用消耗约340万token。在6个涉及不同领域的科学应用中,5个应用在正常无故障运行时添加的开销可忽略不计。从注入进程故障中恢复的效率与人工编写的检查点/重启实现相当。研究认为自动端到端LLM驱动的弹性工程在HPC中技术可行。
Towards Transparent Checkpointing with AI-driven Code Generation
Adding reliable checkpoint/restart support to an MPI scientific application is a time-consuming expert effort that requires deep knowledge of both the application and resilience. We ask whether a frontier large language model can perform this work end-to-end without human intervention. We assemble a benchmark suite of MPI applications spanning diverse domains and computation patterns, and drive an iterative code-generation loop for each application using Anthropic's Claude Opus 4.7 invoked through the OpenCode CLI. Across six scientific applications, the LLM generates working checkpoint/restart code in 50 minutes on average while consuming 3.4 M tokens per application. The generated code adds negligible overhead during normal failure-free execution on five of six applications and recovers from injected process failures with efficiency comparable to human-engineered checkpoint/restart implementations. These results suggest that automated end-to-end LLM-driven resilience engineering is technically viable today for a meaningful fraction of HPC applications.