Gated-delta linear attention layers such as Gated DeltaNet (GDN), Kimi Delta Attention (KDA), and GDN-2 are tuned for GPUs, where small tensor-core tiles and…
机构:Google
来源:arXiv 2611.06828 | AI4Papers 论文推荐平台