Digital Restoration of Visual Art using Synthetic Training, Deep Segmentation and Inpainting

Saptarshi Neil Sinha, Julius Kühn, Johannes Koppe, Holger Graf, Michael Weinmann

Abstract: Deep learning presents promising solutions for the restoration and preservation of visual arts, including old color photographs or paintings, which are prone to degradation over time, enabling the vibrant imagery to be effectively revived and maintained. In this paper, we propose a methodology for restoring visual arts based on deep learning techniques purely trained on synthetic data, thereby involving the generation of a dataset that incorporates respective defects, the training of a respective defect segmentation model, and the inpainting using predicted segmentation maps. Through qualitative and quantitative analysis, we demonstrate the potential of our approach in addressing the scarcity of ground truth data and effectively restoring old visual arts by synthetic training on specific defects observed in historical artworks.

External IDs:dblp:conf/cw/SinhaKKGW24