Solving Inverse Problem With Unspecified Forward Operator Using Diffusion Models

Jialing Zhang, Chongxuan Li, Dequan Wang

Primary Area: generative models

Code Of Ethics: I acknowledge that I and all co-authors of this work have read and commit to adhering to the ICLR Code of Ethics.

Keywords: diffusion models, inverse problems

Submission Guidelines: I certify that this submission complies with the submission instructions as described on https://iclr.cc/Conferences/2024/AuthorGuide.

Abstract: Diffusion models have excelled in addressing a variety of inverse problems. Nevertheless, their application is restricted by the requirement for specific prior knowledge of the forward operator. This paper presents a novel approach, UFODM, which circumvents this constraint by selecting the appropriate forward measurement, making the method more applicable to real-world scenarios. Specifically, our approach enables the concurrent estimation of both the reconstructed image and the characteristics of the forward operator during the inference stage. Our method effectively tackles inverse problems such as blind deconvolution, JPEG restoration, and super-resolution. Furthermore, we demonstrate the versatility of our approach in solving generic inverse problems through the automated selection of forward operators. Empirical evidence suggests that our framework has the potential to enhance the efficacy of diffusion models and extend their applicability in solving real-world inverse problems.

Anonymous Url: I certify that there is no URL (e.g., github page) that could be used to find authors' identity.

No Acknowledgement Section: I certify that there is no acknowledgement section in this submission for double blind review.

Submission Number: 4862