Low-bit quantization reduces the inference cost of LLM agents but can compromise task success. Examining failed rollouts, we find that quantized agents overl…
机构:清华AIR
来源:arXiv 2611.13410 | AI4Papers 论文推荐平台