EEG-Based Evaluation of Aesthetic Experience Using BiLSTM Network

• Published in: International journal of human-computer interaction Vol. 40; no. 23; pp. 8166 - 8179
• Main Authors: Wang, Peishan, Feng, Haibei, Du, Xiaobing, Nie, Rui, Lin, Yudi, Ma, Cuixia, Zhang, Liang
• Format: Journal Article
• Language: English
• Published: Norwood Taylor & Francis 01.12.2024; Lawrence Erlbaum Associates, Inc
• Subjects: Aesthetic design; aesthetic experience; Aesthetics; Algorithms; Arousal; deep learning; EEG; Electroencephalography; Entropy (Information theory); Machine learning; physical product evaluation; Product development
• ISSN: 1044-7318; 1532-7590; 1044-7318
• DOI: 10.1080/10447318.2023.2278926

Evaluation of aesthetic design fulfills a pivotal function in product development, which urges for an efficacious objective method to measure customers' experience. The stability and effectiveness of electroencephalography (EEG) make it a suitable tool for aesthetic experience measurement. Nevertheless, existing studies have several limitations, especially regarding the stimuli and the algorithm. The potential of an EEG-based deep learning model has not been verified in pinpointing subtle differences in physical product aesthetics. To fill the research gap in this issue, we recorded EEG signals in real-life scenarios when participants were presented with different types of physical smartphones, and asked participants to rate them from four dimensions of aesthetic experience (arousal, valence, likeness, and aesthetic evaluation). Then, the time-frequency data were fed into a spatial feature extraction network and an attention-based bidirectional long short-term memory (BiLSTM) optimized by the cross-entropy loss function. The result showed that at 16s window size, the four outcome models yielded the best joint recognition performance of aesthetic experience with an average accuracy of over 85% (arousal: 88.10%, valence: 87.97%, likeness: 85.99%, and aesthetic evaluation: 87.23%). It provides an objective cross-subject recognition method with multi-faceted evaluation results of aesthetic experience. Additionally, we verified the ability of EEG as a reliable and informative resource in terms of aesthetic experience evaluation, even with subtle differences. More practically, a future direction of incorporating EEG signals into subjective product aesthetics measurement could be given more credit.