Muon updates matrix-valued parameters along approximately orthogonalized directions and often trains large language models faster than AdamW, yet it remains …
机构:KAUST
来源:arXiv 2610.30280 | AI4Papers 论文推荐平台