Keqin Peng

Diagnosing and Mitigating Thinking Collapse in On-Policy Self-Distillation

Keqin Peng, Chen Li, Yuanxin Ouyang, Yancheng Yuan, Liang Ding

On-Policy Self-Distillation (OPSD) has emerged as a crucial paradigm for enhancing and aligning Large Language Models (LLMs). However, in complex reasoning tasks, OPSD paradoxically degrades downstream performance. In this paper, we systematically investigate this pathology and i…Read more