Sparse KV compression reduces long-context inference costs by retaining selected historical states, yet these states typically keep their coordinates from th…
机构:国防科大
来源:arXiv 2610.21126 | AI4Papers 论文推荐平台