Recent LLMs increasingly adopt hybrid designs that replace standard attention with linear attention, such as Gated DeltaNet (GDN) and Kimi Delta Attention (K…
机构:UC Berkeley
来源:arXiv 2609.38166 | AI4Papers 论文推荐平台