Multi-token prediction (MTP) improves the throughput of autoregressive generation by enabling the language model to draft multiple next tokens per forward pa…
机构:Microsoft
来源:arXiv 2610.00888 | AI4Papers 论文推荐平台