Dynamic vocabularies built on-the-fly via Lempel-Ziv-Welch (LZW) compression let a language model represent the same text in fewer tokens, but prior work sho…
机构:洛桑联邦理工
来源:arXiv 2610.13605 | AI4Papers 论文推荐平台