arxivcs.LG2026-07-23
Context-weighted Discrete Flow Matching
Daniil Cherniavskii, Daniel Severo, Karen Ullrich
Discrete flow matching provides a flexible framework for generative modeling on discrete structures. However, the standard factorized training objective exposes the model to targets of varying difficulty, mixing well-conditioned, predictable tokens with ambiguous, high-entropy on…