Speculative decoding is a technique that accelerates the inference speed of autoregressive large language models (LLMs) by sampling from a faster, lower qual…
机构:UCLA
来源:arXiv 2610.31819 | AI4Papers 论文推荐平台