arxivcs.LGcs.CLstat.ML2026-07-10
Neural Collapse Is Forbidden: Information Floors in Language Models
Within-class variance in language-model representations is commonly read as incomplete neural collapse. We argue it is allocated information storage, and that the allocation obeys a law. A one-line centering identity voids a family of simplex equiangular-tight-frame claims, inclu…