The Muon optimizer derives its update rule for hidden linear layers by solving a local linearization of the loss penalized by the spectral norm, motivated by…
机构:普渡大学
来源:arXiv 2610.02705 | AI4Papers 论文推荐平台