Asymmetric Dual-Direction Quasi-Recursive Network for Single Hyperspectral Image Super-Resolution

Heng Wang, Cong Wang, Yuan Yuan

Abstract: Single hyperspectral image super-resolution aims to reconstruct a high-resolution hyperspectral image from a low-resolution one, which does not use any auxiliary images. For now, existing super-resolution methods often ignore the difference between the features of neighbor and non-neighbor spectral bands, leaving the feature exploration untargeted. As a result, the complementary information of such bands has not been effectively exploited. To do so, we propose an asymmetric dual-direction quasi-recursive network for single hyperspectral image super-resolution, which separately explores the features among neighbor and non-neighbor bands via forward and backward units. By considering the high similarity among neighbor bands, each forward unit thoroughly exploits spatial-spectral features among such bands through two kinds of correspondence aggregation modules. It also preserves a spectral structure by a spectral band grouping strategy and a spatial-spectral consistency module. Owning to the inconsecutive spectra among non-neighbor bands, backward units focus on extracting spatial features in such bands. With the aid of a global feature context fusion module, the information of global non-neighbor context and neighbor bands are adaptively fused, thus improving information completeness and complementarity. Experimental results reported for natural and remote sensing hyperspectral image datasets demonstrate the proposed network not only outperforms the state-of-the-art methods in terms of reconstruction quality and noise suppression, but also requires a smaller memory footprint.