Generator Surgery for Compressed Sensing

Jung Yeon Park, Niklas Smedemark-Margulies, Max Daniels, Rose Yu, Jan-Willem van de Meent, PAul HAnd

Keywords: generative prior, compressed sensing, inverse imaging

TL;DR: We show that cutting initial layers of a generative signal prior at test time greatly improves image recovery performance.

Abstract: Recent work has explored the use of generator networks with low latent dimension as signal priors for image recovery in compressed sensing. However, the recovery performance of such models is limited by high representation error. We introduce a method to reduce the representation error of such generator signal priors by cutting one or more initial blocks at test time and optimizing over the resulting higher-dimensional latent space. Experiments demonstrate significantly improved recovery for a variety of architectures. This approach also works well for out-of-training-distribution images and is competitive with other state-of-the-art methods. Our experiments show that test-time architectural modifications can greatly improve the recovery quality of generator signal priors for compressed sensing.

Community Implementations: [ 4 code implementations](https://www.catalyzex.com/paper/arxiv:2102.11163/code)