Kumju Jo

Learning to Recover Task Experts from a Multi-Task Merged Model

Jinwook Jung, Taegyu Kim, Kumju Jo, Sungyong Baik

Multi-task model merging aims to consolidate several task-specific experts into a unified model, yet static merging consistently suffers from parameter interference. While dynamic merging models aim to bridge this gap, many works rely on the costly storage and loading of redundan…Read more