On-policy self-distillation (OPSD) trains a student on next-token targets from a teacher, a frozen copy of the student that additionally receives privileged …
机构:Meta
来源:arXiv 2611.16064 | AI4Papers 论文推荐平台