精选理由
StanfordAILab发布了Marin 535B-A23B模型的训练消息，这是他们迄今为止最大的训练项目，值得关注。
StanfordAILab启动了Marin 535B-A23B模型的训练，使用11 x GB200 NVL72进行，预计3个月完成。这是迄今为止最大的训练，预计将出现意外。
原文 · Stanford AI Lab
Exciting!
Exciting! Percy Liang @percyliang 🚢 Marin 535B-A23B started training this week! As usual, the whole process is open. Voyage plan: pretraining (80%) + midtraining (20%) on 18.75T tokens on 11 x GB200 NVL72 for ~3 months (2.7e24 FLOPs). Post-training will follow. Before kicking off the run, we trained a 4-rung scaling ladder from 1.6B-A61M (48B tokens) to 27.7B-A1.2B (926B tokens) to debug issues, and to make a forecast of our hero run. This is by far our biggest run, so definitely expecting the unexpected. 🔗 View Quoted Tweet 💬 1 🔄 1 ❤️ 3 👀 1466 📊 1 ⚡