Evaluating Visual Quality of Autostereoscopic Displays Using an Interactive Perception Network

Zhaoqing Pan, Jiaojiao Yi, Bo Peng, Jianjun Lei, Fu Lee Wang, Nam Ling, Sam Kwong

Abstract: Visual quality assessment of autostereoscopic displays aims to evaluate the stereoscopic visual experience they provide to the viewer, which is crucial for quantifying and optimizing the performance of autostereoscopic displays. In order to automatically evaluate the visual quality of the display, the relationship between the visual quality and the perceptual crosstalk was investigated because the perceptual crosstalk could degrade the visual quality of autostereoscopic displays. However, the visual quality of autostereoscopic displays is comprehensively determined by a series of display parameters such as crosstalk, screen resolution, and screen size, a single display parameter cannot accurately reflect the visual quality. To address this problem, an interactive perception network (IPNet)-based visual quality assessment method is proposed in this article, which models the relationship between the visual quality of the display and the display parameters to accurately evaluate the visual quality of autostereoscopic displays. Since the crosstalk level perceived by the human eye is highly correlated with color differences, a color-informed crosstalk aware module (CCAM) is proposed, which learns features that are highly related to the perceptual crosstalk under the guidance of color difference information. To further analyze the visual impacts of other perceptual fidelity parameters, such as screen resolution, screen size, and viewing angle, a multidomain binocular interaction module (MBIM) is proposed, which models the binocular interaction process in both channel and spatial domains to achieve fine-grained binocular semantic understanding. To train the proposed IPNet for evaluating the visual quality of autostereoscopic displays, a well-annotated large-scale dataset called TJU autostereoscopic display dataset is created, which contains 800 simulated autostereoscopic displays with different display parameters. Extensive experimental results demonstrate that the proposed IPNet achieves state-of-the-art (SOTA) performance in evaluating the visual quality of autostereoscopic displays.