Image-based emotion recognition method and system, storage medium and terminal

• Main Authors: YANG QI, JIA XIUQIN
• Format: Patent
• Language: Chinese; English
• Published: 14.11.2023
• Subjects: CALCULATING; COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS; COMPUTING; COUNTING; HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATIONTECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING ORPROCESSING OF MEDICAL OR HEALTHCARE DATA; INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTEDFOR SPECIFIC APPLICATION FIELDS; PHYSICS

The invention discloses an image-based emotion recognition method and system, a storage medium and a terminal. The method comprises the steps of receiving a to-be-recognized image collected by a camera for a target object; inputting the to-be-recognized image into a pre-trained emotion recognition model; the pre-trained emotion recognition model is established according to a pre-trained Vision Transform network and is generated by training an attention map, and the attention map is generated according to an original image; and outputting an emotion label corresponding to the to-be-recognized image, and determining the emotion of the target object according to the emotion label. The attention map generated according to the original image is adopted for training during model training, so that the model can extract the features of the attention region of the target object, and the key information of the features is increased; meanwhile, the Vision Transform network can be used for extracting global features, so