Marlon Becker

Random Label Prediction Heads for Studying Memorization in Deep Neural Networks

Marlon Becker, Jonas Konrad, Luis Garcia Rodriguez, Benjamin Risse

We introduce a straightforward yet effective method to empirically study memorization in deep neural networks for classification tasks. Our approach augments each training sample with auxiliary random labels, which are then predicted by a random label prediction head (RLP-head).…Read more