Anwar Walid

Three-Pronged Spectral Control for Federated Parameter Efficient Fine Tuning

Shiva Raj Pokhrel, Dipsan Bhattarai, Anwar Walid

Federated parameter-efficient fine-tuning (PEFT) enables communication-efficient adaptation of large pretrained models on decentralized edge data, but it remains fragile under non-IID client heterogeneity. In low-rank adaptation (LoRA), different clients may learn locally useful…Read more