Viewport-oriented Panoramic Image Inpainting

Yanwei Liu

Abstract:

Panoramic images are usually viewed through Head Mounted
Displays (HMDs), which renders only a narrow field of view
from the raw panoramic image. This distinctive viewing feature has largely been ignored when inpainting panoramic images. To address this issue, we propose a viewport-oriented
generative adversarial panoramic image inpainting network
in this paper. For capturing the distorted features accurately
in the generating process of equirectangular projection (ERP)
panoramic image, a latitude-adaptive feature fusion module
is devised to aggregate the latitude-level features in ERP image and less-distorted patch-level viewport-domain features.
Furthermore, a novel cross-domain discriminator is proposed
to force the inpainting network to generate more plausible
results in viewports. Extensive experiments show that our
model achieves better performance compared to the baseline
methods, especially in the viewport images