Hybrid language models interleave a few softmax-attention layers with many linear-attention or state-space layers, so every layer keeps a memory of earlier t…
机构:NVIDIA
来源:arXiv 2611.06084 | AI4Papers 论文推荐平台