Speculative decoding accelerates memory-bound LLM decoding with a lightweight drafter, and parallel drafters extend this speedup by drafting a whole block in…
机构:伯克利
来源:arXiv 2611.02501 | AI4Papers 论文推荐平台