Rafmnet: Reinforced Attention Fusion and Multiscale Network For Noisy Infrared and Visible Image Fusion

Guohua Lv, Xiyan Wang, Yongbiao Gao, Yi Zhai, Guixin Zhao, Guangxiao Ma

Abstract: The purpose of infrared and visible image fusion is to combine the advantages of different types of images to produce more robust and informative images. However, if the source images are noisy, existing fusion methods may not produce clear results. To address this issue, we propose a novel method for infrared and visible image fusion with noise reduction. This method enhances the visual perception of fused images by integrating features of different scales extracted by the denoising network into the fusion network. By using deformable convolutional denoising networks, noise in images can be removed and features can be enhanced. Then, a set of reinforced attention fusion modules (RAFM) are designed to fuse the features extracted by the denoising network. Experimental results demonstrate the effectiveness of our proposed method, which outperforms existing state-of-the-art methods in terms of fusion accuracy and visual perception.