Concept for Human and Computer to Determine Reason Based Scene Location

Adrienne Raglin, Andre V. Harrison

Abstract: The motivation of human computer interaction (HCI) is to improve how humans use computers. One approach can be developing technology that allows the human and computer to collaborate. In some cases creating this type of collaboration or joint approach to for example solve a problem or identify an important piece of information. While some researchers investigate ways that do not include the human, HCI focuses on keeping the technology linked to the human. At this stage in our research, the human is the collaborator utilizing the computer as a teammate to accomplish the task. The task for this work falls under the area of ongoing research in scene understanding. We present a concept that allows the location of an image to be determined based on object detection performed by the computer and the human using reasoning to generate possible candidates for the location that an image can represent. The human may use his or her own knowledge to reason about the options or again working with the computer to glean from reasoning engines that include knowledge. The paper will present this idea and the work that has started.