Real-time Physics-based Removal of Shadows and Shading from Road Surfaces

Bruce A. Maxwell, Casey A. Smith, Maan Qraitem, Ross Messing, Spencer Whitt, Nicolas Thien, Richard M. Friedhoff

Abstract:

We present a real-time physics-based system for gener- ating an illumination free representation of road surfaces that maintains the distinction between asphalt and painted road markings. Cast shadows on road surfaces can cre- ate false features and modify the color of road markings, potentially masking important information for vehicle vi- sion systems. We demonstrate a novel method for identi- fying the relative spectral properties of the direct and am- bient illumination conditions and for using that to create an illumination-free 2D chromaticity space in log RGB. We then show how that representation can be used to gener- ate an illumination-free greyscale representation that dis- tinguishes road, white paint, and yellow paint, making it suitable for further analysis and classification. The entire process runs faster than 30Hz on 1 mega-pixel images using current automotive-grade embedded processing systems.
We evaluate the system on a paint detection task, com- paring two types of learned classifiers, random forests and convolutional neural networks. For each type, one classifier is trained on the original images, and the other is trained on the illumination-free greyscale output. The classifiers are of identical complexity and trained on the same size data set. For both types, the classifier trained on the illumination- free outputs performs better, even on images with no cast shadows. The gap in performance is indicative of the cost of forcing a classifier to learn a task in the presence of the confounding illumination signal.