Vinay Prithyani

Localized LoRA-MoE: Block-wise Low-Rank Experts With Adaptive Routing

Babak Barazandeh, Subhabrata Majumdar, Vinay Prithyani, George Michailidis

Large Language Models (LLMs) and high-dimensional perception networks increasingly rely on parameter-efficient fine-tuning (PEFT) to adapt to diverse operational contexts. However, standard methods like LoRA are structurally limited by a monolithic bottleneck, making them highly…Read more