CoDe: An Explicit Content Decoupling Framework for Image Restoration

Enxuan Gu, Hongwei Ge, Yong Guo

Abstract: The performance of image restoration (IR) is highly de-pendent on the reconstruction quality of diverse contents with varying complexity. However, most IR approaches model the mapping between various complexity contents of inputs and outputs through the repeated feature calcu-lation propagation mechanism in a unified pipeline, which leads to unsatisfactory results. To address this issue, we propose an explicit Content Decoupling framework for IR, dubbed CoDe, to end-to-end model the restoration process by utilizing decoupled content components in a divide-and- conquer-like architecture. Specifically, a Content Decou-pling Module is first designed to decouple content components of inputs and outputs according to thefrequency spec-tra adaptively generatedfrom the transform domain. In ad-dition, in order to harness the divide-and-conquer strategy for reconstructing decoupled content components, we pro-pose an IR Network Container. It contains an optimized version, which is a streamlining of an arbitrary IR net-work, comprising the cascaded modulated subnets and a Reconstruction Layers Pool. Finally, a Content Consistency Loss is designed from the transform domain perspective to supervise the restoration process of each content component and further guide the feature fusion process. Exten-sive experiments on several IR tasks, such as image super-resolution, image denoising, and image blurring, covering both real and synthetic settings, demonstrate that the pro-posed paradigm can effectively take the performance of the original network to a new state-of-the-art level in multiple benchmark datasets (e.g., O.34dB@Set5 × 4 over DAT).