NeuralGiga: Neural Giga-Image Representation with Anti-Aliasing and Continuous Viewing

Xi Luo, Yuwei Li, Minye Wu, Yuexin Ma, Lan Xu, Jingyi Yu

Abstract: A gigapixel image consists of billions of pixels with color information to record fine details of the scene, leading to tremendous data overload for storage and display. Recent advances of gigapixel imaging still suffer from large storage size, I/O overhead or spatial aliasing for achieving real-time rendering especially during zoom-in or zoom-out. To fill this gap, in this paper, we propose NeuralGiga, a novel neural representation of gigapixel images with an effective neural rendering scheme. NeuralGiga implicitly encodes the entire image into a light-weight network which maps pixel coordinates into RGB values with efficient storage overload. In our novel neural rendering network, to enable high-quality giga-image regression with anti-aliasing and continuous viewing effect, we introduce a Spectrum Multi-Layer Perceptron (MLP) design and a Gaussian-based Integrated Random Fourier Feature Mapping (GIRFFM) scheme. Extensive experiments on various scenarios illustrate the effectiveness of our approach to achieve high-quality neural giga-image representation for both storage and display.