Voice Driven Emotion Recognizer Mobile Phone: Proposal and Evaluations

• Published in: International journal of information technology and web engineering Vol. 3; no. 1; pp. 53 - 69
• Main Authors: Razak, Aishah A, Abidin, Mohamad I.Z, Komiya, Ryoichi
• Format: Journal Article
• Language: English
• Published: Hershey IGI Global 01.01.2008
• Subjects: Applications programs; Cell phones; Cellular telephones; Emotions; Evaluation; Image converters; Mobile computing; Nonverbal communication; Personal computers; Prototypes; Telecommunications; Video communication; Videophones; Voice communication; Voice recognition; United States
• ISSN: 1554-1045; 1554-1053
• DOI: 10.4018/jitwe.2008010104

This article proposes an application of emotion recognizer system in telecommunications entitled voice driven emotion recognizer mobile phone (VDERM). The design implements a voice-to-image conversion scheme through a voice-to-image converter that extracts emotion features in the voice, recognizes them, and selects the corresponding facial expression images from image bank. Since it only requires audio transmission, it can support video communication at a much lower bit rate than the conventional videophone. The first prototype of VDERM system has been implemented into a personal computer. The coder, voice-to-image converter, image database, and system interface are preinstalled in the personal computer. In this article, we present and discuss some evaluations that have been conducted in supporting this proposed prototype. The results have shown that both voice and image are important for people to correctly recognize emotion in telecommunications and the proposed solution can provide an alternative to videophone systems. The future works list some modifications that can be done to the proposed prototype in order to make it more practical for mobile applications.