Rahid Zahid Alekberli

Spectral Perturbation of the Empirical Fisher Information Matrix under Weight Quantization

Rahid Zahid Alekberli, Hikmat Karimov

We study the spectral perturbation of the empirical Fisher Information Matrix (FIM) of a parametric statistical model under two structured perturbations: departure of the input from a reference (in-distribution) ensemble, and finite-precision (quantized) perturbation of the model…Read more