Speculative decoding pairs a cheap drafter with parallel verification against the target. At ultra-long context it stops paying, because a drafter that atten…
机构:AMD
来源:arXiv 2610.20865 | AI4Papers 论文推荐平台