arxivcs.LG2026-07-17
Rethinking Transfer in Continual Learning: A Replay-Based Realisation
Yang Meng, Zhenya Liu, Zhuokai Zhao, Yuxin Chen
Continual learning studies how deployed language models can continually acquire new tasks without expensive retraining from scratch. Existing methods, whether rehearsal-based (replaying stored past data) or rehearsal-free (regularising or isolating parameters), overwhelmingly tar…