Enhancing low-light instance segmentation through feature-level denoising

Joanne Lin, David R. Bull, Nantheera Anantrasirichai

Abstract: Instance segmentation accurately delineates the precise boundaries of each distinct object in an image or video. However, performing this task in low-light conditions presents challenges due to issues such as shot noise from low photon counts, color distortions, and reduced contrast. In this work, we propose a plug-and-play solution designed to address these complexities. Our approach integrates weighted non-local blocks (wNLB) into the feature extractor, enabling inherent denoising at the feature level. The proposed method incorporates learnable weights at each layer, allowing the network to adapt to the varying noise characteristics across different feature scales. We demonstrate that our wNLB improves the performance of object detectors and trackers when compared to pretrained networks.

External IDs:doi:10.1117/12.3054001