这项研究解决了 AI 自我改进依赖人工调参的瓶颈，做自动化 Agent 或模型微调的团队值得关注——SIA 的 LoRA 更新思路能低成本让模型学会任务模式，比只改提示更有效。
一篇论文提出 SIA（自我改进 AI）框架，让 AI 通过观察任务代理的表现，自动调整外部设置（如提示、工具、重试规则）或更新模型权重（通过 LoRA 适配器）。在三个差异极大的任务（中文法律罪名分类、GPU 内核速度调优、单细胞 RNA 去噪）上，结合设置与权重更新的版本均优于仅改进设置的方法。这表明，除了优化提示和工具，让模型通过任务反馈学习模式能带来额外提升。
This paper shows an AI improving itself better whe…
This paper shows an AI improving itself better when it rewrites its setup and updates its model.
The problem is that most AI progress still depends on people changing prompts, tools, code, training data, and model weights by hand.
The paper’s idea is SIA, a loop where one AI watches how a task agent performs, then either changes the agent’s outer setup or trains the model itself.
The outer setup means things like prompts, tools, retry rules, and output parsing, while weight updates mean changing the model’s learned behavior through task feedback.
The loop works like this: the task agent tries many answers or programs, the verifier scores them, and those scores become training feedback.
Then the system updates a small add-on set of weights called LoRA weights, which changes the model’s behavior without retraining the whole model.
So the base model stays mostly the same, but the LoRA adapter learns, “outputs like this got high reward, outputs like that failed.”
The authors tested this on 3 very different tasks: Chinese legal charge classification, GPU kernel speed tuning, and single-cell RNA denoising.
The combined version beat setup-only improvement on all 3 tasks, reaching 70.1% on LawBench, faster GPU code than the prior best, and 0.289 on denoising.
The main lesson is that better scaffolding helps the agent act better, but weight updates help it learn task patterns that prompts and tools alone did not find.
----
Link – arxiv. org/abs/2605.27276
Title: "SIA: Self Improving AI with Harness & Weight Updates"