Johannes Knittel

Sparse Inter-Layer Dependencies of Transformer FFN Neurons

Johannes Knittel, Hanspeter Pfister

Feedforward network (FFN) blocks account for a large fraction of the parameters and computation in Transformer architectures, yet their internal structure remains difficult to interpret due to the additive superposition induced by the residual stream. We examine whether the activ…Read more