Speculative decoding is a successful technique speeding up inference of a target autoregressive language model via a fast drafter model. Lossy speculative de…
机构:Google
来源:arXiv 2609.30474 | AI4Papers 论文推荐平台