arxivcs.IRcs.AIcs.LG2026-06-26
Bifocal Diffusion Language Models: Asymmetric Bidirectional Context for Parallel Generation
Yuhang Chen, Xianfeng Wu, Jinhao Duan, Mingfu Liang, Xiaohan Wei, Yunchen Pu, et al.
Discrete diffusion language models (dLLMs) recover masked tokens in parallel, offering significant speedups over autoregressive (AR) generation. However, such promising frameworks face a fundamental architectural design dilemma: \ding{182} Adopting bidirectional attention achieve…