A hand gesture recognition technique for human–computer interaction

• Published in: Journal of visual communication and image representation Vol. 28; pp. 97 - 104
• Main Authors: Kılıboz, Nurettin Çağrı, Güdükbay, Uğur
• Format: Journal Article
• Language: English
• Published: Elsevier Inc 01.04.2015
• Subjects: Adaptive gestures; Dynamic gesture recognition; Finite state machine-based recognition; Gestural interfaces; Gesture-based interaction; Hand gesture; Hand trajectory recognition; Human-computer interaction; Intuitive interfaces; Gestural interfaces; Gesture-based interaction; Hand trajectory recognition; Dynamic gesture recognition; Human-computer interaction; Intuitive interfaces; Hand gesture; Finite state machine-based recognition; Adaptive gestures
• ISSN: 1047-3203; 1095-9076
• DOI: 10.1016/j.jvcir.2015.01.015

•We propose an approach to recognize dynamic hand gestures for human–computer interaction.•The proposed approach is trajectory based and works in real time.•We use a six-degrees-of-freedom position tracker to collect trajectory data.•We represent gestures as an ordered sequence of directional movements in 2D.•We use finite state machines for recognizing gestures. We propose an approach to recognize trajectory-based dynamic hand gestures in real time for human–computer interaction (HCI). We also introduce a fast learning mechanism that does not require extensive training data to teach gestures to the system. We use a six-degrees-of-freedom position tracker to collect trajectory data and represent gestures as an ordered sequence of directional movements in 2D. In the learning phase, sample gesture data is filtered and processed to create gesture recognizers, which are basically finite-state machine sequence recognizers. We achieve online gesture recognition by these recognizers without needing to specify gesture start and end positions. The results of the conducted user study show that the proposed method is very promising in terms of gesture detection and recognition performance (73% accuracy) in a stream of motion. Additionally, the assessment of the user attitude survey denotes that the gestural interface is very useful and satisfactory. One of the novel parts of the proposed approach is that it gives users the freedom to create gesture commands according to their preferences for selected tasks. Thus, the presented gesture recognition approach makes the HCI process more intuitive and user specific.