Genetic algorithms reveal profound individual differences in emotion recognition

• Published in: Proceedings of the National Academy of Sciences - PNAS Vol. 119; no. 45; pp. 1 - 8
• Main Authors: Binetti, Nicola, Roubtsova, Nadejda, Carlisi, Christina, Cosker, Darren, Viding, Essi, Mareschal, Isabelle
• Format: Journal Article
• Language: English
• Published: United States National Academy of Sciences 08.11.2022
• Subjects: Adult; Algorithms; Anger - physiology; Avatars; Biological Sciences; Emotion recognition; Emotional factors; Emotions; Emotions - physiology; Facial Expression; Facial Recognition; Genetic algorithms; Humans; Individuality; Social Sciences; genetic algorithms; faces; machine learning; emotion recognition; facial expressions
• ISSN: 0027-8424; 1091-6490; 1091-6490
• DOI: 10.1073/pnas.2201380119

Emotional communication relies on a mutual understanding, between expresser and viewer, of facial configurations that broadcast specific emotions. However, we do not know whether people share a common understanding of how emotional states map onto facial expressions. This is because expressions exist in a high-dimensional space too large to explore in conventional experimental paradigms. Here, we address this by adapting genetic algorithms and combining them with photorealistic three-dimensional avatars to efficiently explore the high-dimensional expression space. A total of 336 people used these tools to generate facial expressions that represent happiness, fear, sadness, and anger. We found substantial variability in the expressions generated via our procedure, suggesting that different people associate different facial expressions to the same emotional state. We then examined whether variability in the facial expressions created could account for differences in performance on standard emotion recognition tasks by asking people to categorize different test expressions. We found that emotion categorization performance was explained by the extent to which test expressions matched the expressions generated by each individual. Our findings reveal the breadth of variability in people’s representations of facial emotions, even among typical adult populations. This has profound implications for the interpretation of responses to emotional stimuli, which may reflect individual differences in the emotional category people attribute to a particular facial expression, rather than differences in the brain mechanisms that produce emotional responses.