Henry D. Pfister

Conservation Laws for Diffusion Models

Ziv Aharoni, Henry D. Pfister

While autoregressive models optimize the exact data likelihood via the chain rule, diffusion models are typically trained with denoising objectives. We develop conservation laws based on generalized extrinsic information transfer (GEXIT) functions for a broad class of memoryless…Read more