arxiveess.SPcs.LG2026-07-02
Fourier Preconditioning for Neural Feature Learning
Preston Pitzer, Anish Pradhan, Harpreet S. Dhillon
Mutual information (MI)-inspired feature learning techniques are capable of generating low-dimensional embeddings that retain nonlinear dependence structures, but direct estimations of MI suffer from noisy probability distribution estimates in the low-data regime. The H-Score obj…