Speech emotion recognition method and system fusing multiple modes

• Main Authors: LIU YUNXIANG, ZHANG KEXIN, YUAN XINXIN
• Format: Patent
• Language: Chinese; English
• Published: 12.08.2022
• Subjects: ACOUSTICS; MUSICAL INSTRUMENTS; PHYSICS; SPEECH ANALYSIS OR SYNTHESIS; SPEECH OR AUDIO CODING OR DECODING; SPEECH OR VOICE PROCESSING; SPEECH RECOGNITION

The invention provides a multi-mode fused speech emotion recognition method and system, and the method comprises the steps: obtaining a speech signal, and carrying out the extraction of a speech emotion feature value from the speech signal; obtaining text information corresponding to the voice signal, and preprocessing the text information to generate text feature information; obtaining a pre-trained speech emotion classifier, wherein the speech emotion classifier comprises a first classification model and a second classification model; inputting the speech emotion feature value and the text feature information into the speech emotion classifier, recognizing the speech emotion feature value through a first classification model to generate first classification information, and recognizing the text feature information through a second classification model to generate second classification information, and fusing the first classification information and the second classification information to generate identific