Thinking Machines 发布 v2 小模型:68 小时预训练,NVFP4 全程训练
Soumith Chintala 团队的 v2 小模型来了,全程 NVFP4 训练,现在已经能在 Tinker 上微调,下周开源权重。
v2 小模型已上线,预训练在 GB300 上跑了 68 小时,后训练用了 1700 万次 rollout、耗时 9 天。从预训练到后训练全程使用 NVFP4 精度。现在可以在 Tinker 平台上训练和微调,开源权重将在外部安全测试完成后于下周发布。
Our v2 small model is here. I've been using it daily for a variety of things.
The pre-training ran for 68 hours on GB300s. Post-training was 17 million rollouts over 9 days. Entirely pre-mid-post trained in NVFP4.
Available to train and fine-tune on Tinker right now. Open weights next week after external safety testing is fully complete (cant skimp on that).
Continuing to decentralize and democratize intelligence...