KV cache eviction must decide which entries carry information that the rest of the cache can no longer supply. A natural way to estimate this is a learnable …
机构:港科大
来源:arXiv 2611.07605 | AI4Papers 论文推荐平台