Video-Based Human Behavior Understanding: A Survey

• Published in: IEEE transactions on circuits and systems for video technology Vol. 23; no. 11; pp. 1993 - 2008
• Main Authors: Borges, Paulo Vinicius Koerich, Conci, Nicola, Cavallaro, Andrea
• Format: Journal Article
• Language: English
• Published: New York, NY IEEE 01.11.2013; Institute of Electrical and Electronics Engineers; The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
• Subjects: Applied sciences; Artificial intelligence; Behavior; Behavior analysis; Behavioral science; Computer science; control theory; systems; Computer vision; Detection, estimation, filtering, equalization, prediction; Exact sciences and technology; Feature extraction; Hidden Markov models; human detection; Image processing; Information, signal and communications theory; Pattern recognition. Digital image processing. Computational geometry; Services and terminals of telecommunications; Signal and communications theory; Signal processing; Signal, noise; Support vector machines; Systems, networks and services of telecommunications; Telecommunications; Telecommunications and information theory; Telemetry. Remote supervision. Telewarning. Remote control; video analysis; Computer vision; Range finding; Image processing; human detection; Behavior analysis; Coverage; video analysis; Image analysis; Aspect oriented; Signal processing; Feature extraction; Safety; Motion analysis; Artificial intelligence; Comparative study; Monitoring; Indexing
• ISSN: 1051-8215; 1558-2205
• DOI: 10.1109/TCSVT.2013.2270402

Understanding human behaviors is a challenging problem in computer vision that has recently seen important advances. Human behavior understanding combines image and signal processing, feature extraction, machine learning, and 3-D geometry. Application scenarios range from surveillance to indexing and retrieval, from patient care to industrial safety and sports analysis. Given the broad set of techniques used in video-based behavior understanding and the fast progress in this area, in this paper we organize and survey the corresponding literature, define unambiguous key terms, and discuss links among fundamental building blocks ranging from human detection to action and interaction recognition. The advantages and the drawbacks of the methods are critically discussed, providing a comprehensive coverage of key aspects of video-based human behavior understanding, available datasets for experimentation and comparisons, and important open research issues.