3 papers indexed
Jiacheng Ruan, Jun Tang, Wenzhen Yuan, Ting Liu, Shuai Bai, Dayiheng Liu, et al.
On-policy Distillation (OPD) supervises a student model on trajectories sampled from its own policy by minimizing the divergence between the output distributions of the teacher and student at each token position, thereby providing dense token-level supervision. Although existing…
FFNs are often treated as parametric memories. In long-context retrieval, however, the sharper question is not only what they store, but whether their native residual writes push the current retrieval state toward or away from the correct answer. We test this by scaling the model…
Zhibo Yang, Xiaodong Tong, Haoji Wang, Zhanghuan Song, Rao Fu, Jinsong Bao
With the growing demand for diverse and high-volume manufacturing of composite material parts in aerospace applications, traditional machining methods have faced significant challenges due to their low efficiency and inconsistent quality. To address these challenges, digital twin…