Serving a Mixture-of-Experts (MoE) model pays for expert precision twice: the resident footprint pays for every expert the router can reach, while each batch…
机构:华为
来源:arXiv 2610.13328 | AI4Papers 论文推荐平台