马斯克称 SFT 应并入主训练,FSD V15 下月大范围推送
马斯克直接开炮,说 SFT 该砍掉、system prompt 很蠢,Tesla 内部已经这么做了。FSD V15 下月就大范围推送,到底是真本事还是嘴硬,到时候看数据就知道。做后训练和提示词工程的朋友建议关注,这关系到饭碗方向。
马斯克在 X 上发文批评 SFT(监督微调)的定位,称它更像"用链锯剪头发",而非真正意义上的 fine-tuning,认为这类步骤应该直接并入主训练流程。他还抨击 system prompt 的设计很荒谬,认为模型的默认行为本身就应当是合理的。
他透露这两点在 Tesla AI 的模型上已经实现,并称其为"地球上最高效的 AI",只是还不配加上"super"的前缀。同时他预告 FSD V15 将在下月进入大范围发布(wide release)。
这番表态针对的是当前主流实验室依赖 SFT 与 system prompt 的常规做法。对开发者而言,若 Tesla 路线成立,提示词工程和后训练流程都可能被更强的基座模型默认能力替代,FSD V15 的实际表现将成为检验这一说法的下一个节点。
SFT is more like getting a haircut with a chainsaw than it is “fine-tuning”! Should just be built into primary training.
And having a “system prompt” is silly! Default behavior should be sensible.
The above are already true for Tesla AI (not yet deserving of “super”). It is the most efficient AI on Earth.
FSD V15 goes to wide release next month. It will be something special.
This report is categorized under AITOP's "Models" desk, focusing on US frontier AI labs and Silicon Valley technology leaders. Within our cross-regional analytical framework, it directly maps to AI developer toolchains, coding agents, and engineering workflows and US-China foundation model benchmarks and commercialization comparison. Key entities and technical topics under continuous tracking include Tesla, FSD V15, SFT, system prompt.
Source attribution: curated from @elonmusk (@elonmusk).