Miguel C. Soriano

Scalar Representations of Neural Network Training Dynamics

Pedro Jiménez-González, Miguel C. Soriano, Lucas Lacasa

Training in artificial neural networks can be viewed as a trajectory evolving through a high-dimensional loss landscape. However, the large number of trainable parameters makes the direct analysis of these dynamics challenging. In this work, we treat such training trajectories as…Read more