arxivcs.LGcs.AI2026-07-12
Weight-Adjusted Gradients Reveal Parameter Importance and Failure Modes in LLMs
Shrestha Datta, Hongfu Liu, Anshuman Chhabra
Understanding which parameters are influential in Large Language Models (LLMs) is central to improving their efficiency, reliability, and interpretability. We introduce Weight-Adjusted Gradients (WAG), a simple yet effective approach for estimating parameter importance that expli…