Leveraging facial expressions as emotional context in image captioning

• Published in: Multimedia tools and applications Vol. 83; no. 30; pp. 75195 - 75216
• Main Authors: Das, Riju, Wu, Nan, Dev, Soumyabrata
• Format: Journal Article
• Language: English
• Published: New York Springer US 01.09.2024; Springer Nature B.V
• Subjects: Artificial neural networks; Computer Communication Networks; Computer Science; Computer vision; Data Structures and Information Theory; Datasets; Emotions; Human subjects; Multimedia; Multimedia Information Systems; Natural language; Neural networks; Special Purpose and Application-Based Systems; Track 6: Computer Vision for Multimedia Applications; Image captioning; Facial cues; Facial expression; Facial emotion recognition

Image captioning has emerged as a prominent approach for generating verbal descriptions of images that humans can read and understand. Numerous techniques and models in this domain have predominantly focused on analyzing the factual elements present within an image, employing convolutional neural ne...