Agentic LLM inference accumulates long KV caches across iterative observation-reasoning-action loops, imposing substantial memory overhead and limiting servi…
机构:中科大
来源:arXiv 2609.31395 | AI4Papers 论文推荐平台