Replit CEO Amjad Masad 提出模型可即时训练领域专用替代模型
Replit CEO Amjad Masad 提了个有意思的思路：通用 Agent 干活时发现自己只被用来干一种活，就顺手训练个小模型顶替自己，便宜又更安全，像 JIT 编译器。
Replit CEO Amjad Masad 在 X 上把这一设想类比为 JIT 编译器：通用模型在执行任务（如 Operator、Astra 这类大模型）时发现某个用例范围有限，就可以即时训练一个更专用的模型来接替自己。他指出这类专用模型更便宜、更不容易被 prompt 注入攻击，也因为能力更受限而危害更小。他认为相比讨论 recursive self-improvement，"模型训练自己的替代品"这个方向讨论还很少。
Who’s building this? a16z @a16z Replit CEO Amjad Masad on how general models could train smaller, domain-specific models on the fly: "There's a lot of talk of recursive self-improvement, but there's something I don't think is getting a lot of discussion, which is models training their replacements." "You can think of it as a just-in-time compiler. As you're executing dynamic code, the interpreter realizes there's an opportunity to optimize, and it emits machine code on the fly that's a lot more optimized." "You can imagine general models, you're doing something with Operator or Astra, some of the big models, and they realize the use case is limited, or some other agent observing realizes the use case is limited." "General agents have all these flaws, but there's also more potential for them to be harmful, more potential for them to go off the rails." "So the model, on the fly, trains a model that could be its replacement, but is a lot more domain specific. Therefore it's cheaper, less vulnerable to prompt injections, and less harmful for you, because it's less capable." "It's almost like a system that's training machine learning models for specific use cases as it's monitoring the entire system." @amasad Your browser does not support the video tag. 🔗 View on Twitter 🔗 View Quoted Tweet 💬 19 🔄 6 ❤️ 85 👀 9552 📊 26 ⚡
