A User-Developed 3-D Hand Gesture Set for Human–Computer Interaction

• Published in: Human factors Vol. 57; no. 4; pp. 607 - 621
• Main Authors: Pereira, Anna, Wachs, Juan P., Park, Kunwoo, Rempel, David
• Format: Journal Article
• Language: English
• Published: Los Angeles, CA SAGE Publications 01.06.2015; Human Factors and Ergonomics Society
• Subjects: 3-D technology; Adolescent; Adult; Aged; Biomechanics; Ergonomics; Fatigue; Fatigue (materials); Female; Gestures; Hand (anatomy); Hand - physiology; Hands; Human factors; Human factors research; Human-computer interaction; Human-computer interface; Humans; Male; Middle Aged; Movement; Ratings; Risk; Tasks; Three dimensional; User-Computer Interface; Young Adult; fatigue; usability; human–computer interaction; HCI; gesture
• ISSN: 0018-7208; 1547-8181
• DOI: 10.1177/0018720814559307

Objective: The purpose of this study was to develop a lexicon for 3-D hand gestures for common human–computer interaction (HCI) tasks by considering usability and effort ratings. Background: Recent technologies create an opportunity for developing a free-form 3-D hand gesture lexicon for HCI. Method: Subjects (N = 30) with prior experience using 2-D gestures on touch screens performed 3-D gestures of their choice for 34 common HCI tasks and rated their gestures on preference, match, ease, and effort. Videos of the 1,300 generated gestures were analyzed for gesture popularity, order, and response times. Gesture hand postures were rated by the authors on biomechanical risk and fatigue. Results: A final task gesture set is proposed based primarily on subjective ratings and hand posture risk. The different dimensions used for evaluating task gestures were not highly correlated and, therefore, measured different properties of the task–gesture match. Application: A method is proposed for generating a user-developed 3-D gesture lexicon for common HCIs that involves subjective ratings and a posture risk rating for minimizing arm and hand fatigue.