KV cache eviction methods such as SnapKV and PyramidKV rank tokens solely by mean attention over a small observation window. We study a unified score, $μ_i+λ…
机构:佐治亚理工
来源:arXiv 2609.30738 | AI4Papers 论文推荐平台