Multiview Light Field Angular Super-Resolution Based on View Alignment and Frequency Attention

Deyang Liu, Yifan Mao, Youzhi Zhang, Xin Zheng, Yifan Zuo, Yuming Fang

Abstract: The Light Field (LF) camera, renowned for its ability to capture both the intensity and directional aspects of light rays simultaneously, has garnered widespread attention. However, the plenoptic LF camera encounters a constraint in its field of view due to sensor limitations. To address this challenge, this paper introduces a multiview LF angular super-resolution method based on view alignment and frequency attention. Specifically, we first propose an alignment paradigm to acquire the targeted sparse LF image by warping its adjacent two sparse LF views to their target positions. Moreover, an angular frequency attention block is introduced to meticulously discern global high-frequency details within LF images. Subsequently, the structural information is extracted through the application of a gradient-guided method to guarantee the geometric consistency. Comprehensive experiments verify the effectiveness of our proposed method in both single LF angular reconstruction and multiview LF reconstruction tasks.