As pretraining increasingly repeats data, every run faces three questions: how many epochs to take, how that number should change with model size, and whethe…
机构:ETH Zurich
来源:arXiv 2610.05591 | AI4Papers 论文推荐平台