Jerry Liu分享了把通用模型变成专用模型的方法,能省成本又提精度,还说了未来可以自动搞。
Jerry Liu指出,对于任何给定任务,总可以将通用模型或代理框架蒸馏为专用模型或工作流,从而获得更高准确率和更低成本。领域越窄,优化空间越大,还可以提供比聊天界面更针对性的用户体验。随着代理自我改进能力增强,未来可以通过定义顶层目标和评估标准自动完成蒸馏,无需人工编码。
I do think that for any given task, you can always distill a generalized model/agent harness into a ...
I do think that for any given task, you can always distill a generalized model/agent harness into a specialized model/harness/workflow for higher accuracy and lower cost. The more narrow the data and task domain, the more opportunity there is to optimize performance (not to mention provide a more targeted UX vs. a chat interface). As agents get better at improving themselves, I think you can start to perform this distillation automatically, by defining a top-level goal and evaluation rubric, instead of codifying the workflow through code or natural language. Jerry Liu @jerryjliu0 x.com/i/article/2077… 🔗 View Quoted Tweet 💬 3 🔄 0 ❤️ 13 👀 916 📊 4 ⚡