Combining Color and Geometry for the Active, Visual Recognition of Shadows

Gareth Funka-Lea, Ruzena Bajcsy

Abstract: Shadows are a frequent occurrence, but they cannot be infallibly recognized until a scene's geometry and lighting are known. We present a number of cues which together strongly suggest the identification of a shadow and which can be examined with low cost. The techniques are: a color image segmentation method that recovers single material surfaces as single image regions irregardless of the surface partially in shadow, a method to recover the penumbra and umbra of shadow; a method for determining whether some object could be obstructing a light source. The last cue requires the examination of well understood shadows in the scene. Our observer is equipped with an extendable probe for casting its own shadows. Actively obtained shadows allow the observer to experimentally determine the location of the light sources in the scene. The system has been tested both indoors and out.<