Speculative decoding accelerates large language model inference with a small drafter, whose per-guess acceptance rate determines the achievable speedup. Feat…
机构:Google
来源:arXiv 2611.05724 | AI4Papers 论文推荐平台