Papers10:56Chinese contentMuon训练的Transformer在后grokking阶段出现表示-读出界面崩溃Muon grok虽快,后grokking会崩到27.59%;冻结embedding/readout就能稳。想用Muon训Transformer的注意。#Muon#AdamW#grokking#模块化加法aarXiv cs.LG@Ali Janati et al. (4)SourceRead laterReadWorth followingUsefulFollow Muon