Quantification of Active Visual Attention using RGB camera

• Published in: 2023 45th Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC) Vol. 2023; pp. 1 - 4
• Main Authors: Karmakar, Somnath, Chatterjee, Debatri, Varghese, Tince, Gavas, Rahul Dasharath, S, Mithun B, Ramakrishnan, Ramesh Kumar, Pal, Arpan
• Format: Conference Proceeding Journal Article
• Language: English
• Published: United States IEEE 01.01.2023
• Subjects: Blinking; Cameras; Cognition; Ear; Humans; Magnetic heads; Male; Portable computers; Privacy; Real-time systems; Visualization
• ISSN: 2694-0604
• DOI: 10.1109/EMBC40787.2023.10340011

Active visual attention (AVA) is the cognitive ability that helps to focus on important visual information while responding to a stimulus and is important for human-behavior and psychophysiological research. Existing eye-trackers/camera-based methods are either expensive or impose privacy issues as face videos are recorded for analysis. Proposed approach using blink-rate variability (BRV), is inexpensive, easy to implement, efficient and handles privacy issues, making it amenable to real-time applications. Our solution uses laptop camera/webcams and a single blink feature, namely BRV. First, we estimated participant's head pose to check camera alignment and detect if he is looking at the screen. Next, subject-specific threshold is computed using eye aspect ratio (EAR) to detect blinks from which BRV signal is constructed. Only EAR values are saved, and participant's face video is NOT saved or transmitted. Finally, a novel AVA score is computed. Results shows that the proposed score is robust across participants, ambient light conditions and occlusions like spectacles.