Imitation learning of hand gestures and its evaluation for humanoid robots

• Published in: 2010 International Conference on Information and Automation pp. 60 - 65
• Main Authors: Thobbi, Anand, Weihua Sheng
• Format: Conference Proceeding
• Language: English
• Published: IEEE 01.06.2010
• Subjects: Data mining; Elbow; Feature extraction; Hand Gestures; Human-Robot Interaction; Humanoid robots; Humanoids; Humans; Imitation Learning; Orbital robotics; Programming by Demonstration; Robotics and automation; Shoulder; Testing; USA Councils
• ISBN: 1424457017; 9781424457014
• DOI: 10.1109/ICINFA.2010.5512333

This paper presents a platform to implement and evaluate a learning by imitation framework which enables humanoid robots to learn hand gestures from human beings. A marker based system is used to capture human motion data. From this data we extract the shoulder and elbow joint angles, which uniquely characterize a particular hand gesture. The proposed imitation learning framework aims to generalize over multiple demonstrations of the same hand gesture and thus learn it. The set of joint angle trajectories used for training are first aligned temporally using Dynamic Time Warping (DTW) and then generalized by weighted averaging. The framework operates in the joint space. The algorithm has been implemented and tested on the Nao Humanoid robot. We also propose a novel method to evaluate the proposed imitation learning framework. We place markers on the robot's arm analogous to the placement of markers on the human subject's arm, and then compare the respective joint angle trajectories.