Perceptual Experience Analysis for Tone-mapped HDR Videos Based on EEG and Peripheral Physiological Signals

• Published in: IEEE transactions on autonomous mental development Vol. 7; no. 3; pp. 236 - 247
• Main Authors: Moon, Seong-Eun, Lee, Jong-Seok
• Format: Journal Article
• Language: English
• Published: IEEE 01.09.2015
• Subjects: Assessments; Biomedical monitoring; Classification; Conduction; Dynamic range; Dynamical systems; Electroencephalography; Electroencephalography (EEG); Feature extraction; Frequency bands; high dynamic range video; physiological signal; Physiology; quality of experience (QoE); Skin; Three-dimensional displays; Videos
• ISSN: 1943-0604; 1943-0612
• DOI: 10.1109/TAMD.2015.2449553

High dynamic range (HDR) imaging has been attracting much attention as a technology that can provide immersive experience. Its ultimate goal is to provide better quality of experience (QoE) via enhanced contrast. In this paper, we analyze perceptual experience of tone-mapped HDR videos both explicitly by conducting a subjective questionnaire assessment and implicitly by using EEG and peripheral physiological signals. From the results of the subjective assessment, it is revealed that tone-mapped HDR videos are more interesting and more natural, and give better quality than low dynamic range (LDR) videos. Physiological signals were recorded during watching tone-mapped HDR and LDR videos, and classification systems are constructed to explore perceptual difference captured by the physiological signals. Significant difference in the physiological signals is observed between tone-mapped HDR and LDR videos in the classification under both a subject-dependent and a subject-independent scenarios. Also, significant difference in the signals between high versus low perceived contrast and overall quality is detected via classification under the subject-dependent scenario. Moreover, it is shown that features extracted from the gamma frequency band are effective for classification.