Robert D. Nowak

Deep Neural Variation Spaces: A Unifying Perspective on Depth and Complexity

Julia Nakhleh, Robert D. Nowak

We develop a unified function space theory of deep fully connected neural networks. Functions in our spaces are defined recursively as $\ell^1$-bounded linear combinations of activated functions from preceding layers, with a dictionary of affine functions at the first layer. Unli…Read more