Publications

Waving Real Hand Gestures Recorded by Wearable Motion Sensors to a Virtual Car and Driver in a Mixed-Reality Parking Game

Publication Type Conference Paper
Authors David Bannach, Oliver Amft, Kai S. Kunze, Ernst A. Heinz, Gerhard Tröster, Paul Lukowicz
Title Waving Real Hand Gestures Recorded by Wearable Motion Sensors to a Virtual Car and Driver in a Mixed-Reality Parking Game
Abstract We envision to add context awareness and ambient intelligence to edutainment and computer gaming applications in general. This requires mixed-reality setups and ever-higher levels of immersive human-computer interaction. Here, we focus on the automatic recognition of natural human hand gestures recorded by inexpensive, wearable motion sensors. To study the feasibility of our approach, we chose an educational parking game with 3-D graphics that employs motion sensors and hand gestures as its sole game controls. Our implementation prototype is based on Java-3D for the graphics display and on our own CRN Toolbox for sensor integration. It shows very promising results in practice regarding game appeal, player satisfaction, extensibility, ease of interfacing to the sensors, and – last but not least – sufficent accuracy of the real-time gesture recognition to allow for smooth game control. An initial quantitative performance evaluation confirms these notions and provides further support for our setup.
Date April 2007
Proceedings Title CIG 2007: Proceedings of the 2nd IEEE Symposium on Computational Intelligence and Games
Publisher IEEE Press
Pages 32–39
DOI 10.1109/CIG.2007.368076
Full Text PDF
Friedrich-Alexander-Universität Erlangen-Nürnberg