First-Person Vision

For understanding the behavior, intent, and environment of a person, the surveillance metaphor is traditional; that is, install cameras and observe the subject, and his/her interaction with other people and the environment. Instead, we argue that the first-person vision (FPV), which senses the envir...

Full description

Saved in:
Bibliographic Details
Published inProceedings of the IEEE Vol. 100; no. 8; pp. 2442 - 2453
Main Authors Kanade, Takeo, Hebert, Martial
Format Journal Article
LanguageEnglish
Published IEEE 01.08.2012
Subjects
Behavioral science
Computer vision
eye tracking
Image matching
Intelligent systems
Object recognition
Quality assessment
quality of life technologies
Service robots
Surveillance
Tracking
Videos
Wearable sensors
Online AccessGet full text

Cover

More Information
Summary:For understanding the behavior, intent, and environment of a person, the surveillance metaphor is traditional; that is, install cameras and observe the subject, and his/her interaction with other people and the environment. Instead, we argue that the first-person vision (FPV), which senses the environment and the subject's activities from a wearable sensor, is more advantageous with images about the subject's environment as taken from his/her view points, and with readily available information about head motion and gaze through eye tracking. In this paper, we review key research challenges that need to be addressed to develop such FPV systems, and describe our ongoing work to address them using examples from our prototype systems.
ISSN:0018-9219
1558-2256
DOI:10.1109/JPROC.2012.2200554