Xiao-Song Yang

Minimum Block Width for Universal Approximation by Residual Neural Networks with Inner Width One

Qi Zhou, Xuan Zhou, Xiao-Song Yang

In this paper, we study the universal approximation property of residual neural networks, and obtain some new results. For input and output dimensions $d_x$ and $d_y$, and LeakyReLU, ReLU, ReLU-like activation functions, the upper and lower bounds of the minimum block width are e…Read more