#SAMuon

1 stories · 0 in 7 days · 0 in 30 days

Muon 1 optimization algorithms 1 large language models 1

Stories, products and papers tagged "SAMuon", newest first.

Aug 27

PapersSelected11:02

Muon Optimizer Outperforms Adam in LLM Training

SAMuon reduces training token requirements by 13.3-24.0% compared to Muon, offering significant efficiency gains for researchers and companies training large language models in ASEAN.

#Muon #large language models #optimization algorithms #SAMuon

arXiv cs.LG@Xiaodong Wu et al. (4)Source