Frequency Regularized Deep Convolutional Dictionary Learning and Application to Blind Denoising

Nikola Pavle Janjusevic, Amirhossein Khalilian-Gourtani, Yao Wang

Keywords: Dictionary learning, unrolled algorithm, convolutional sparse coding, interpretable deep learning, inverse problems, blind denoising, LISTA

Abstract: Sparse representation via a learned dictionary is a powerful prior for natural images. In recent years, unrolled sparse coding algorithms (e.g. LISTA) have proven to be useful for constructing interpretable deep-learning networks that perform on par with state-of-the-art models on image-restoration tasks. In this study we are concerned with extending the work of such convolutional dictionary learning (CDL) models. We propose to construct strided convolutional dictionaries with a single analytic low-pass filter and a set of learned filters regularized to occupy the complementary frequency space. By doing so, we address the necessary modeling assumptions of natural images with respect to convolutional sparse coding and reduce the mutual coherence and redundancy of the learned filters. We show improved denoising performance at reduced computational complexity when compared to other CDL methods, and competitive results when compared to popular deep-learning models. We further propose to parameterize the thresholds in the soft-thresholding operator of LISTA to be proportional to the estimated noise-variance from an input image. We demonstrate that this parameterization enhances robustness to noise-level mismatch between training and inference.

One-sentence Summary: We propose to construct strided, frequency-regularized, convolutional dictionaries for use in an unrolled deep-learning model, demonstrating application in blind and non-blind natural image denoising.

Code Of Ethics: I acknowledge that I and all co-authors of this work have read and commit to adhering to the ICLR Code of Ethics

Reviewed Version (pdf): https://openreview.net/references/pdf?id=re54pzqJyp