Image-to-Image Translation for Near-Infrared Image Colorization

Hyeongyu Kim, Jonghyun Kim, Joongkyu Kim

Abstract: In the existing near-infrared image colorization methods, the main obstacles are distortion of color consistency and texture. We propose a feature fusion module using multi-scale channel attention module (MS-CAM) that extracts edges by Canny filter and fuses two colorized images with feature maps. The proposed method improves the PSNR of NIR2VC compared to the baseline on VSIAD datasets and output has consistency to the exterior wall of the building. Moreover, the proposed method well captures textures in objects. However, when predicting gray color like roads and cars, artifacts are occurred and the output tends to be slightly brighter. This method can also be applied to the field of monitoring such as CCTV and military facilities, as well as thermal imaging cameras with properties similar to near-infrared rays.