Haidong Kang

RSLoRA: Training-free Rank Allocation for LoRA via Representational Sensitivity Probing

Jiaqi Liu, Haidong Kang, Qihui Zhao, Guo Yu

Low-Rank Adaptation (LoRA) has become a cornerstone of parameter-efficient fine-tuning (PEFT); however, the conventional practice of uniform rank assignment ignores the functional heterogeneity of neural layers. Existing rank allocation methods typically struggle with a trade-off…Read more