Intelligent interaction method and device based on multimode fusion

• Main Author: TONG HONGWEI
• Format: Patent
• Language: Chinese; English
• Published: 17.01.2023
• Subjects: ARRANGEMENT OF SIGNALLING OR LIGHTING DEVICES, THE MOUNTING ORSUPPORTING THEREOF OR CIRCUITS THEREFOR, FOR VEHICLES INGENERAL; PERFORMING OPERATIONS; TRANSPORTING; VEHICLES IN GENERAL; VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISEPROVIDED FOR

The embodiment of the invention relates to the field of man-machine interaction, and discloses an intelligent interaction method and device based on multi-mode fusion, and the method comprises the steps: obtaining multi-mode information, generating interaction data according to the multi-mode information, and outputting the interaction data. Wherein the multi-modal information comprises one or a combination of more of vehicle state information, vehicle position information, user information and environment information. According to the method, all-around data acquisition is carried out on the vehicle and the user to generate interaction data, so that the interaction device can actively interact with the user, the problem that a vehicle-mounted man-machine interaction system cannot effectively fuse multi-dimensional user and vehicle information is solved, and the user experience is improved. And the vehicle-mounted man-machine interaction system can actively provide interaction services meeting the current req