网友猜测 Meta Spark 1.3 提升或来自从 OpenAI 蒸馏
有人怀疑 Meta 的 Spark 1.3 进步是靠从 OpenAI 蒸馏来的,所以才不敢开源,看看这个推理过程挺有意思。
X 用户 teortaxesTex 发帖推测,Meta 的 Spark 模型从 1.2 到 1.3 的性能跃升,部分原因可能是从 OpenAI 模型蒸馏而来。其依据是 Meta 拒绝开源 1.3 版本、不公开完整 CoT。帖中还提到 Meta 内部已转向 Wonder/WFull 项目,但对外发布的是质量较低的模型。
I now suspect that Meta's great jump between Spark 1.2 and 1.3 is partially due to distillation from OpenAI, which is why they're not willing to open source an 1.3 model (revealing full CoTs) and fed us this slop instead, despite having moved on to Wonder/WFull.