Real-time face relighting via adaptive normal mapping

Pradeep Choudhary, Sumedh Mannar, Amit Kumar, Minjung Son

Abstract: In this paper, we present a real-time face relighting method for enhancing widely used face photographs such as `selfies'. In contrast with previous relighting methods that estimate and replace the real lighting condition with the intended one, our technique focuses on the aesthetic aspects of relighting with real-time interaction. We estimate the head pose based on the facial features and apply adaptive face normal mapping by transforming and interpolating pre-defined face normal maps. The lighting effect is calculated using adaptively mapped normals and overlaid on the original photograph. The experimental results show that the proposed method generates aesthetic face photographs without a computational overhead, enabling real-time face relighting for mobile applications.