Skeleton Joints Moment (SJM): A Hand Gesture Dimensionality Reduction for Central Nervous System Interaction

• Published in: IEEE access Vol. 9; pp. 146640 - 146652
• Main Authors: Kahar, Zainal Abdul, Sulaiman, Puteri Suhaiza, Khalid, Fatimah, Azman, Azreen
• Format: Journal Article
• Language: English
• Published: Piscataway IEEE 2021; The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
• Subjects: Augmented reality; Central nervous system; Computational modeling; dimensionality reduction; Electronic devices; Gesture recognition; Hand gesture recognition; hologram; Human-computer interface; Joints (anatomy); Machine learning; Machine learning algorithms; Mathematical models; Nervous system; Principal component analysis; Principal components analysis; Reduction; Task analysis; Training; Virtual reality
• ISSN: 2169-3536; 2169-3536
• DOI: 10.1109/ACCESS.2021.3123570

Recent breakthroughs with numerous visual experiences using mobile devices encourage the research of human-computer interaction (HCI) involving hand gesture recognition for Holograms, Virtual Reality, and Augmented Reality. The rise of these technologies allows educators in medical segments to apply new pedagogy by interacting with virtual content in a coherent learning environment. This paper proposed the Central Nervous System (CNS) interaction using the Skeleton Joints Moment (SJM) approach for dimension reduction with k Nearest Neighbour (k-NN) for hand gesture classification. Over the past few decades, researchers have proposed various techniques in dimension reduction. One of the methods is principal component analysis (PCA). Experimental results indicated that the SJM technique has similar accuracy to PCA, where both methods showed 96% of prediction using hand skeleton joints data. In addition, PCA has a higher uncertainty of mean error 0.75 compared to SJM at only 0.01. Furthermore, PCA has the worst complexity of <inline-formula> <tex-math notation="LaTeX">O(min(p^{3},n^{3})) </tex-math></inline-formula> where SJM <inline-formula> <tex-math notation="LaTeX">O(n/d) </tex-math></inline-formula>. Evaluation results using the T-Test showed a significant difference between SJM and PCA where <inline-formula> <tex-math notation="LaTeX">p < 0.05 </tex-math></inline-formula>. Thus, there is evidence to reject the null hypothesis.