Speculative decoding has become a mainstream technique for accelerating large language model (LLM) inference by using a lightweight draft model to generate c…
机构:上交
来源:arXiv 2610.23787 | AI4Papers 论文推荐平台