Parallel block drafting accelerates speculative decoding by predicting multiple future positions in a single backbone pass, but on-device deployment constrai…
机构:Microsoft
来源:arXiv 2611.07263 | AI4Papers 论文推荐平台