Speculative decoding losslessly accelerates large language model inference by having a lightweight draft model predict future tokens for verification by the …
机构:Harvard
来源:arXiv 2609.24197 | AI4Papers 论文推荐平台