Wireless Kinect-NAO Framework Based on Takagi-Sugeno Fuzzy Inference System

• Published in: Information technologies and control Vol. 15; no. 2; pp. 14 - 24
• Main Authors: Lekova, A., Krastev, A., Chavdarov, I.
• Format: Journal Article
• Language: English
• Published: Sciendo 01.06.2017
• Subjects: Microsoft Kinect V2; NAO robot; Teleoperation; telerobotics, Takagi–Sugeno fuzzy system; view invariance
• ISSN: 1312-2622; 2367-5357; 1312-2622
• DOI: 10.1515/itc-2017-0023

In the context of learning new skills by imitation for children with special educational needs, we propose Wireless Kinect-NAO Framework (WKNF) for robot teleoperation in real time based on Takagi-Sugeno (T-S) Fuzzy Inference System. The new solutions here are related to complex whole-body motion retargeting, standing body stabilization, view invariance and smoothness of robot motions. The raw depth Kinect data are fuzzified and processed by median filter. The joint angles estimation for motion mapping of Human to NAO movements is based on fuzzy logic and featured angles rather than direct angles are calculated by Inverse Kinematics due to differences in the human and robot kinematics. During the joint angles calculation nonlinearities are observed as a result of ambiguity of Kinect 3D joint coordinates in different offsets. NAO kinematic limitations and nonlinearities in workspace are decomposed and linearly approximated by T-S fuzzy rules of zero and first order that have local support in 2D projections. To prevent the robot to fall down, the center of mass is considered in order NAO to stay within a support and safe polygon. The feasibility of the proposed framework has been proven by real experiments.