arxivstat.MLcs.LGmath.ST2026-07-22
Statistical Inference for Rank Allocation in Low-Rank Adaptation
Low-rank adaptation (LoRA) has become a widely used parameter-efficient fine-tuning method for large language models. Since different modules and layers may contribute unequally to downstream adaptation, allocating rank resources under a fixed parameter budget is an important pro…