Cycle-Consistent Sparse Unmixing Network Based on Deep Image Prior

Yifan Zhang, Chaoqun Dong, Shaohui Mei

Abstract: A cycle-consistent sparse unmixing network based on deep image prior (C2SU-DIP) is proposed in this paper, to reduce the complexity of sparse unmixing (SU) algorithm and the loss of details in hyperspectral images (HSIs) simultaneously. In the proposed C2SU-DIP network, the complex design of regularization terms in sparse unmixing is avoided, meanwhile, details of abundances are effectively retained. It employs DIP-based sparse unmixing network as the backbone, and the learning process of the network replaces the regularization term design. Furthermore, cycle consistency is introduced by cascading two backbone networks, and a cycle consistency constrained loss function is designed for image detail preservation. Experimental results illustrate that the newly proposed C2SU-DIP network is capable of obtaining competitive unmixing results compared with several representative spectral unmixing methods.