Defining Rules Among Devices in Smart Environment Using an Augmented Reality Headset

Heonjin Park, Kyle Koh, Yuri Choi, Han Joo Chae, Jeongin Hwang, Jinwook Seo

Abstract: We present a pilot study that uses optical head-mounted displays (OHMD) as an augmented reality headset to view and define rules among various augmented objects in the environment. In the traditional augmented reality techniques on mobile devices, the users must hold the devices in their hands as a viewing window to the physical world. Instead, the OHMD are attached to the users' head, allowing them to view objects and related information by turning their heads and directly gazing at the objects. In a crowded urban environment surrounded by IoT devices, OHMD can reveal the presence and capability of the devices to users. Also, free movement of hands leave an opportunity to use them for interaction, e.g. via mid-air gestures. This paper describes an early prototype and a preliminary result from a pilot study to test feasibility of interacting with virtual objects that augment physical objects using OHMD. We found that basic interaction for building new rules among them were easy to learn and use, while fine-tuning of them using the conventional GUI components left rooms for improvement.