As sequence lengths continue to grow, distributed attention based on sequence parallel (e.g., Ring-Attention) has become a mainstream solution for large lang…
机构:联想研究院
来源:arXiv 2611.05906 | AI4Papers 论文推荐平台