A Comprehensive Benchmark for Neural Human Radiance Fields

Kenkun Liu, Derong Jin, Ailing Zeng, Xiaoguang Han, Lei Zhang

Keywords: Benchmark, Human Body Rendering, Human NeRF, Generalizable NeRF, Novel Pose Rendering

Abstract: The past two years have witnessed a significant increase in interest concerning NeRF-based human body rendering. While this surge has propelled considerable advancements, it has also led to an influx of methods and datasets. This explosion complicates experimental settings and makes fair comparisons challenging. In this work, we design and execute thorough studies into unified evaluation settings and metrics to establish a fair and reasonable benchmark for human NeRF models. To reveal the effects of extant models, we benchmark them against diverse and hard scenes. Additionally, we construct a cross-subject benchmark pre-trained on large-scale datasets to assess generalizable methods. Finally, we analyze the essential components for animatability and generalizability, and make HumanNeRF from monocular videos generalizable, as the inaugural baseline. We hope these benchmarks and analyses could serve the community.

Submission Number: 109