A Real-Time Interactive System Based on Hand Gesture Recognition in Virtual Fitting

Lin Yang, Long Ye, Wei Zhong, Yingying Zhang, Qin Zhang

Abstract: Hand gesture interaction has already become a research focus with the rapid development of virtual reality technologies. In this paper, we present a real-time interactive system based on hand gesture recognition in virtual fitting. Firstly, real-time data of hand gesture are captured by Leap Motion sensor. Then, we analyze the data and set the parameter projection to the hand model in virtual environment. Finally, the interaction with objects in the virtual environment will be realized by real-time gesture recognition. Application environment is designed as a virtual fitting room. Users can view virtual clothing by gesture interaction. Experiments show that the system is efficient and user friendly. And system’s gesture recognition has good real-time performance and accuracy.