Draw with Me: Human-in-the-Loop for Image Restoration

Thomas Weber, Zhiwei Han, Stefan Matthes, Heinrich Hußmann, Yuanting Liu

Abstract: The purpose of image restoration is to recover the original state of damaged images. To mitigate the disadvantages of the manual image restoration process such as the high time consumption, we present interactive Deep Image Prior by extending Deep Image Prior with a user interface to an interactive process with the human in the loop. In this process, a human can iteratively embed knowledge to provide guidance and control for the automated inpainting process. Our evaluation shows that, even with very little human guidance, our interactive approach has a restoration performance on par or superior to other methods. Meanwhile, very positive results of our user study suggest that learning systems with the human-in-the-loop positively contribute to user satisfaction.