Beyond the Ground Truth: Enhanced Supervision for Image Restoration

Donghun Ryou, Inju Ha, Sanghyeok Chu, Bohyung Han

Keywords: Image Restoration, Image Enhancement, Ground Truth, Perceptual Quality

Abstract:

Deep learning-based image restoration has achieved significant success.
However, when addressing real-world degradations, model performance is limited by the quality of ground-truth images in datasets due to practical constraints in data acquisition.
To address this limitation, we propose a novel framework that enhances existing ground truth images to provide higher-quality supervision for real-world restoration.
Our framework generates perceptually enhanced ground truth variants using super-resolution, and employs a conditional frequency mask generator to produce adaptive frequency masks.
These masks guide the optimal fusion of frequency components from the original ground truth and its super-resolved variants to yield enhanced ground truth images.
This frequency-domain mixup preserves the semantic consistency of the original content while selectively enriching perceptual details, preventing hallucinated artifacts that could compromise fidelity.
The enhanced ground truth images are used to train a lightweight output refinement network that can be seamlessly integrated with existing restoration models.
Extensive experiments demonstrate that our approach consistently improves the quality of restored images.
We further validate the effectiveness of both supervision enhancement and output refinement through user studies.
We will publicly release our code, enhanced images and model weights to support reproducibility.

Primary Area: applications to computer vision, audio, language, and other modalities

Submission Number: 16148