Kaifeng Lyu

Building Multi-Task Agentic LLMs via Two-Phase Distillation

Huaijie Wang, Shusheng Xu, Yi Wu, Kaifeng Lyu

A key step toward artificial general intelligence is to train models that can perform multiple tasks. In this paper, we study how to build such models by first training separate RL experts for individual tasks and then consolidating them via distillation, as an alternative to dir…Read more