arxivcs.LGmath.ST2026-07-03
The Multiscale Single-Index Model: A Stylized Model for Hierarchical Feature Learning
We consider the Multiscale Single-Index Model (MSIM), first introduced in \cite{oymak2021learning}, as a stylized model for hierarchical learning with \emph{scale separation}. Each layer extracts a shared single-index feature at one physical scale and passes it to the next, thus…