Artificial intelligence can emulate human normative judgments on emotional visual scenes

• Published in: Royal Society open science Vol. 12; no. 7; pp. 250128 - 7
• Main Authors: Romeo, Zaira, Testolin, Alberto
• Format: Journal Article
• Language: English
• Published: England The Royal Society Publishing 01.07.2025; The Royal Society
• Subjects: affective computing; Artificial intelligence; Cognition; Computer Science and Artificial Intelligence; Emotions; Experiments; foundation models; Human subjects; Language; Likert scale; multimodal language models; NAPS; Ratings; Ratings & rankings; NAPS; affective computing; artificial intelligence; foundation models; multimodal language models
• ISSN: 2054-5703; 2054-5703
• DOI: 10.1098/rsos.250128

Affective reactions have deep biological foundations; however, in humans, the development of emotion concepts is also shaped by language and higher-order cognition. A recent breakthrough in artificial intelligence (AI) has been the creation of multimodal language models that exhibit impressive intellectual capabilities, but their responses to affective stimuli have not been investigated. Here, we study whether state-of-the-art multimodal systems can emulate human emotional ratings on a standardized set of images, in terms of affective dimensions and basic discrete emotions. The AI judgements correlate surprisingly well with the average human ratings: given that these systems were not explicitly trained to match human affective reactions, this suggests that the ability to visually judge emotional content can emerge from statistical learning over large-scale databases of images paired with linguistic descriptions. Besides showing that language can support the development of rich emotion concepts in AI, these findings have broad implications for sensitive use of multimodal AI technology.