arxivcs.CVcs.LG2026-07-20
Brain-Aligned Multi-Stream Video Transformers with Sparse Self-Selection
Amir Hosein Fadaei, Mahyar Maleki, Mohammad-Reza A. Dehaqani
Modern video transformers typically ignore principles from primate vision and are rarely evaluated against neural data, limiting their biological interpretability. We introduce a sparse winner-takes-all token selection module that replaces dense self-attention to improve efficien…