Transref: Multi-scale reference embedding transformer for reference-guided image inpainting

Taorong Liu, Liang Liao, Delin Chen, Jing Xiao, Zheng Wang, Chia-Wen Lin, Shin'ichi Satoh

Abstract: Highlights•We explored reference-guided image inpainting which introduces a reference image to restore realistic and original scenes.•We proposed the reference embedding procedure to solve the unique feature alignment problem in reference-guided image inpainting locally and globally.•We constructed the DPED50K dataset to provide a benchmark and advance the reference-guided inpainting reseach.•Extensive experiments show the efficacy of the reference images and the superiority of our method.