METHOD, DEVICE AND COMPUTER PROGRAM FOR EMOTION RECOGNITION FROM A REAL-TIME AUDIO SIGNAL

The invention relates to a computer implemented method for a computer implemented method (200) for real-time emotion recognition from a real-time audio signal (102), said method (200) comprising several iterations of an emotion detection phase comprising the following steps:-transcription (106), int...

Full description

Saved in:
Bibliographic Details
Main Authors ALISAMIR, Sina, RINGEVAL, Fabien
Format Patent
LanguageEnglish
French
German
Published 21.06.2023
Subjects
ACOUSTICS
CALCULATING
COMPUTING
COUNTING
ELECTRIC DIGITAL DATA PROCESSING
MUSICAL INSTRUMENTS
PHYSICS
SPEECH ANALYSIS OR SYNTHESIS
SPEECH OR AUDIO CODING OR DECODING
SPEECH OR VOICE PROCESSING
SPEECH RECOGNITION
Online AccessGet full text

Cover

More Information
Summary:The invention relates to a computer implemented method for a computer implemented method (200) for real-time emotion recognition from a real-time audio signal (102), said method (200) comprising several iterations of an emotion detection phase comprising the following steps:-transcription (106), into text, an audio speech signal contained is said audio signal (102) by an automatic speech recognition model,- computing (112), by a speech representation model, a joint representation vector (JRVi) corresponding to a joint representation of said speech as a function of said speech signal and said text,- computing (114), by an emotion prediction model, an emotion embedding vector (EEVi), as a function of said joint representation vector (JRVi), and- mapping (116) said emotion in at least one emotional frame (120;124), according to said emotion embedding vector (EEVi), by an emotion mapping model.The invention further relates to a computer program and a device implementing such a method.
Bibliography:Application Number: EP20210306787