Denoisers with Differentiable Constraint Knowledge for Diffusion Models

Victor M. Yeom-Song, Severi Rissanen, Arno Solin, Samuel Kaski, Mingfei Sun

Track: Track 1: Original Research/Position/Education/Attention Track

Keywords: Diffusion Models, Inverse Problems, Constrained Generation

TL;DR: We present a method to embed differentiable constraints as inductive biases in a score matching diffusion model

Abstract: Diffusion models are powerful generative models for complex data distributions, yet they often struggle to generate samples that precisely satisfy constraints inherent in scientific applications. While recent approaches have introduced regularization terms or guidance methods to enforce such constraints, they lead to bias in the generative distribution, compromising the model's ability to faithfully represent the true data distribution. In this extended abstract, we propose a different approach that embeds arbitrary denoiser architectures with differentiable constraints as inductive biases from initialization, maintaining the asymptotic unbiasedness of standard denoising score matching. Through experiments on a representative PDE problem, we show that our method generates constraint-compliant samples without the distributional biases introduced by current methods.

Submission Number: 245