A Multimodal Emotion Recognition Using the Facial Image and Speech Signal

In this paper, we propose an emotion recognition method using the facial images and speech signals. Six basic emotions including happiness, sadness, anger, surprise, fear and dislike are investigated. Facia] expression recognition is performed by using the multi-resolution analysis based on the disc...

Full description

Saved in:
Bibliographic Details
Published inInternational journal of fuzzy logic and intelligent systems : IJFIS Vol. 5; no. 1; pp. 1 - 6
Main Authors Go, Hyoun-Joo, Kim, Yong-Tae, Chun, Myung-Geun
Format Journal Article
LanguageKorean
Published 2005
Subjects
Human Interface
Speech Recognition
Independent Component Analysis
Fuzzy Membership Function
Face Recognition
Emotion Recognition
Online AccessGet full text

Cover

More Information
Summary:In this paper, we propose an emotion recognition method using the facial images and speech signals. Six basic emotions including happiness, sadness, anger, surprise, fear and dislike are investigated. Facia] expression recognition is performed by using the multi-resolution analysis based on the discrete wavelet. Here, we obtain the feature vectors through the ICA(Independent Component Analysis). On the other hand, the emotion recognition from the speech signal method has a structure of performing the recognition algorithm independently for each wavelet subband and the final recognition is obtained from the multi-decision making scheme. After merging the facial and speech emotion recognition results, we obtained better performance than previous ones.
Bibliography:KISTI1.1003/JNL.JAKO200516610534328
ISSN:1598-2645
2093-744X