arxivcs.LGcs.CLcs.DC2026-07-20
Mobius Learning: Cyclic Depth Folding in Transformers
Transformer-based language models organize computation along an ordered depth axis, where shallow and deep blocks often develop distinct representational roles. We challenge the conventional view that these roles must remain tied to a block's position in the ordered sequence. We…