Online data selection has demonstrated substantial efficiency gains for LLM pretraining by training on the most valuable candidates within each batch. Since …
机构:洛桑联邦理工
来源:arXiv 2610.03432 | AI4Papers 论文推荐平台