Mid-training (MT) is a training phase in LLM training pipelines that continues pretraining (PT) on smaller datasets of higher value. Taking the PT and MT pha…
机构:清华
来源:arXiv 2610.29348 | AI4Papers 论文推荐平台