Speculative decoding is a popular decode acceleration method. As such, it is particularly relevant to long-output generation, which requires an increasingly …
机构:NVIDIA
来源:arXiv 2610.31098 | AI4Papers 论文推荐平台