Hand tracking and gesture recognition system for human-computer interaction using low-cost hardware

Human-Computer Interaction (HCI) exists ubiquitously in our daily lives. It is usually achieved by using a physical controller such as a mouse, keyboard or touch screen. It hinders Natural User Interface (NUI) as there is a strong barrier between the user and computer. There are various hand trackin...

Full description

Saved in:
Bibliographic Details
Published inMultimedia tools and applications Vol. 74; no. 8; pp. 2687 - 2715
Main Authors Yeo, Hui-Shyong, Lee, Byung-Gook, Lim, Hyotaek
Format Journal Article
LanguageEnglish
Published Boston Springer US 01.04.2015
Springer Nature B.V
Subjects
Accuracy
Analysis
Augmented reality
Cameras
Computer & video games
Computer Communication Networks
Computer Science
Data Structures and Information Theory
Fingers
Hardware
Human-computer interaction
Interactive
Interfaces
Kalman filters
Keyboards
Multimedia
Multimedia computer applications
Multimedia Information Systems
Pattern recognition
Recognition
Special Purpose and Application-Based Systems
Studies
Tracking
Tracking control systems
Tracking systems
User interface
Kinect
NUI
Hand/Finger tracking
Gesture recognition
Motion game
HCI
Online AccessGet full text

Cover

More Information
Summary:Human-Computer Interaction (HCI) exists ubiquitously in our daily lives. It is usually achieved by using a physical controller such as a mouse, keyboard or touch screen. It hinders Natural User Interface (NUI) as there is a strong barrier between the user and computer. There are various hand tracking systems available on the market, but they are complex and expensive. In this paper, we present the design and development of a robust marker-less hand/finger tracking and gesture recognition system using low-cost hardware. We propose a simple but efficient method that allows robust and fast hand tracking despite complex background and motion blur. Our system is able to translate the detected hands or gestures into different functional inputs and interfaces with other applications via several methods. It enables intuitive HCI and interactive motion gaming. We also developed sample applications that can utilize the inputs from the hand tracking system. Our results show that an intuitive HCI and motion gaming system can be achieved with minimum hardware requirements.
Bibliography:ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 23
ISSN:1380-7501
1573-7721
DOI:10.1007/s11042-013-1501-1