Cognitive load objective measurement method based on multi-channel face video

• Main Authors: TOYONAGA ATSUSHI, WANG YIGE, WEI GANG, CAO YAN
• Format: Patent
• Language: Chinese; English
• Published: 10.10.2023
• Subjects: CALCULATING; COMPUTING; COUNTING; DIAGNOSIS; ELECTRIC DIGITAL DATA PROCESSING; HUMAN NECESSITIES; HYGIENE; IDENTIFICATION; MEDICAL OR VETERINARY SCIENCE; PHYSICS; SURGERY

The invention discloses a cognitive load objective measurement method based on multi-channel face videos, which comprises the following steps of: recording the multi-channel face videos when a subject executes mental calculation tasks with different difficulties, extracting oxyhemoglobin saturation and pulse variability through the multi-channel face videos, and recording the correct rate of the mental calculation tasks at the same time; and objectively measuring the cognitive load by using the indexes. The method comprises the following steps of: simultaneously acquiring face videos when a subject executes mental calculation tasks with different difficulties through a plurality of independent cameras, and recording the correct rate of the mental calculation tasks; pulse waves are extracted from the multi-channel face video and denoised, the denoised pulse waves are subjected to time synchronization and fusion to obtain pulse waves with the high signal-to-noise ratio, and multiple physiological indexes are ex