A Reservoir Computing Framework for Continuous Gesture Recognition

Stephan Tietz, Doreen Jirak, Stefan Wermter

Abstract: We present a novel gesture recognition system for the application of continuous gestures in mobile devices. We explain how meaningful gesture data can be extracted from the inertial measurement unit of a mobile phone and introduce a segmentation scheme to distinguish between different gesture classes. The continuous sequences are fed into an Echo State Network, which learns sequential data fast and with good performance. We evaluated our system on crucial network parameters and on our established metric to compute the number of successfully recognized gestures and the number of misclassifications. On a total of ten gesture classes, our framework achieved an average accuracy of 85%.