Vehicle-mounted interaction system based on emotion perception and voice interaction

• Main Authors: YANG JINSU, KATSU, SU HAO, YANG CHANGCHUN, WANG ZIYAO, WEI XING
• Format: Patent
• Language: Chinese; English
• Published: 06.05.2022
• Subjects: ARRANGEMENT OF SIGNALLING OR LIGHTING DEVICES, THE MOUNTING ORSUPPORTING THEREOF OR CIRCUITS THEREFOR, FOR VEHICLES INGENERAL; ARRANGEMENTS OR ADAPTATIONS OF HEATING, COOLING, VENTILATING,OR OTHER AIR-TREATING DEVICES SPECIALLY FOR PASSENGER OR GOODSSPACES OF VEHICLES; CALCULATING; COMPUTING; COUNTING; HANDLING RECORD CARRIERS; PERFORMING OPERATIONS; PHYSICS; PRESENTATION OF DATA; RECOGNITION OF DATA; RECORD CARRIERS; TRANSPORTING; VEHICLES IN GENERAL

The invention provides a vehicle-mounted interaction system based on emotion perception and voice interaction. The system is applied to a vehicle-mounted terminal and comprises an information acquisition module, an emotion analysis module and an execution module. The camera collects passenger information and transmits the passenger information to the analysis module, the emotional state of a passenger is obtained through a facial emotion analysis method, and the execution module starts matched preset operation. The preset operation comprises modes of intelligent voice interaction, automatic driving system starting, RGB atmosphere lamp adjustment, music adjustment, in-vehicle fragrance adjustment and the like. The emotion and intention of the passenger can be captured and analyzed in real time, interaction is carried out in a voice mode, the expectation of the user for intelligent voice and emotional perception is met, for the passenger, the change of the emotion can influence the change of the environment in