Long-context inference makes the key-value (KV) cache a major memory bottleneck for large language models. We propose BELT, a low-rank KV cache compression f…
机构:北大
来源:arXiv 2610.17966 | AI4Papers 论文推荐平台