Continual pre-training (CPT) adapts large language models (LLMs) to specialized domains, yet its standard next-token prediction (NTP) objective treats every …
机构:阿里
来源:arXiv 2611.13855 | AI4Papers 论文推荐平台