CoreWeave Forge 推出模型蒸馏预览版
CoreWeave 出了个蒸馏功能,用大模型教小模型干单一任务,成本能省不少,现在能试用
CoreWeave 在 Forge 平台上线 Model Distillation 预览功能。做法是选一个能力强的大模型当老师,让它教一个小的学生模型完成单一任务。文中举的例子是 GLM-5.3 及其 Flash 变体。学生模型推理快、适合规模化,能把单一任务的成本从前沿模型价格降下来。
CoreWeave Model Distillation is in preview in CoreWeave Forge.
Start with a teacher that has "the best big model smell that you can get," as @altryne put it on ThursdAI, and let it teach a small student your one task. GLM-5.3 and its Flash variant are the familiar example.
The student is quick at scale, and that one job stops costing frontier prices.
Try it here: https://t.co/mbGEgF9q4b