See the World through Color-tinted Glasses for Better Hyperspectral Reconstruction

ICLR 2026 Conference Submission17008 Authors

Keywords: hyperspectral reconstruction

Abstract:

Hyperspectral reconstruction (HSR) from RGB images is a fundamentally ill-posed problem due to severe spectral information loss.
Existing approaches typically rely on a single RGB image, limiting reconstruction accuracy.
In this work, we propose a novel multi-image-to-hyperspectral reconstruction (MI-HSR) framework that leverages a triple-camera smartphone system, where two lenses are equipped with carefully selected spectral filters.
Our configuration, grounded in theoretical and empirical analysis, enables richer and more diverse spectral representations than conventional single-camera setups.
To support this new paradigm, we introduce Doomer, the first dataset for MI-HSR, comprising aligned images from three smartphone cameras and a hyperspectral reference camera across diverse scenes.
We show that the proposed HSR model achieves consistent improvements over existing methods on the newly proposed benchmark.
In a nutshell, our setup allows 30\% towards more accurately estimated spectra compared to an ordinary RGB camera.
Our findings suggest that multi-view spectral filtering with commodity hardware can unlock more accurate and practical hyperspectral imaging solutions.

Primary Area: applications to computer vision, audio, language, and other modalities

Submission Number: 17008