Visual attention and cognitive process in construction hazard recognition: Study of fixation-related potential

• Published in: Automation in construction Vol. 148; p. 104756
• Main Authors: Zhang, Qingwen, Liang, Mingxuan, Chan, Albert P.C., Liao, Pin-Chao
• Format: Journal Article
• Language: English
• Published: Elsevier B.V 01.04.2023
• Subjects: Construction hazard recognition; EM and EEG co-registration; Fixation-based cognitive activity; Fixation-related potential; Visual search pattern; Visual search pattern; Fixation-related potential; Fixation-based cognitive activity; Construction hazard recognition; EM and EEG co-registration
• ISSN: 0926-5805; 1872-7891
• DOI: 10.1016/j.autcon.2023.104756

Previous studies on hazard recognition focused on single-mode neuropsychological responses using eye tracking or neuroimaging techniques, reflecting a limited understanding of the interaction between ocular and brain activities. This study explores the construction workers' meta-cognitive processes underpinning first target fixations using co-registration of eye movement (EM) and electroencephalography (EEG). The authors conducted a hazard recognition experiment to collect EM and EEG signals under free viewing conditions and examined the relationship between visual attention and cognitive processing. The results show that the workers allocated cognitive resources first to processing targets' visual features and then to discriminating safe or hazardous characteristics. Visual perception and conscious discrimination within first fixations are related to the prior detection of surroundings and affect the subsequent refixations. This study promotes evaluating the hazard recognition process in view of synchronous visual search and brain activity and advances the workers' hazard search patterns. •EM and EEG co-registration technique is applied in construction hazard recognition.•The workers' cognitive processes within first attention periods are decoded.•The effects of hazard features on fixation metrics and FRP components are examined.•Interaction of visual attention and cognitive processing is analyzed.