Varun Reddy

Conditioned Direct Feedback Alignment via Activity and Error Geometry

Houman Safaai, Varun Reddy, Bernardo L. Sabatini

Direct feedback alignment (DFA) trains hidden layers with fixed random projections of the output error, avoiding the transposed-weight backward pass of backpropagation (BP). We study a failure mode of DFA training that is distinct from feedback quality: the local weight update is…Read more