arxivcs.LG2026-07-03
Co-Adaptive Multi-Task LoRA: Transfer-Aware, Label-Free Control of Domain Participation
Wei Zhang, Lin Tang, Ming Zhao, Yuxuan Wang
Fine-tuning a single low-rank adapter on many domains at once is multi-task learning: the domains must be co-learned, and how they share the adapter decides whether they help or hurt one another. Most efficient fine-tuning pipelines ignore this and train on a fixed, uniform mixtu…