Serving large language models (LLMs) under tight memory and latency service-level objectives (SLOs), including on edge devices, requires jointly selecting th…
机构:UT Austin
来源:arXiv 2611.07570 | AI4Papers 论文推荐平台