Human-to-Computer Interaction Using Hand Gesture Tracking System

• Published in: Proceedings of International Conference on Recent Trends in Computing Vol. 600; pp. 501 - 513
• Main Authors: Verma, Raunaq, Agrawal, Raksha, Thuwal, Nisha, Bohra, Nirbhay, Saxena, Pranshu
• Format: Book Chapter
• Language: English
• Published: Singapore Springer Nature Singapore 01.01.2023; Springer Singapore Pte. Limited
• Series: Lecture Notes in Networks and Systems
• Subjects: Colour detection; Gesture recognition; Human–computer interaction; Image processing; Virtual mouse; Web camera
• ISBN: 9789811988240; 9811988242
• ISSN: 2367-3370; 2367-3389
• DOI: 10.1007/978-981-19-8825-7_43

A virtual mouse with fingertip identification and hand motion tracking based on visuals in a live video is one of the research projects in human–computer interaction. A real-time fingertip-gesture-based interface is still problematic for human–computer interactions because of sensor noise, changing light levels, and the challenge of tracking a fingertip over a variety of subjects. When you don’t have a mouse, using your fingertip as a virtual mouse is a typical technique to interact with computers. Hand gestures were used to control mouse movement and mouse click events in this work. A virtual mouse is controlled using fingertip identification and hand gesture recognition. Various approaches have been utilised to produce the virtual mouse in recent years. Finger tracking is done in this study utilising coloured finger caps. Finger detection utilising colour identification, hand motion recognition, and mouse control implementation are the three key phases to implement this. The user must apply the RGB colour tapes to his or her fingers so that he or she may easily make motions for each tape, as well as a combination of these three-coloured tapes will help us to obtain the appropriate cursor movement output in the system.