Artificial intelligence-driven multi-modal detection system and method

• Main Authors: JIA QINGSHENG, YIN YONGYANG, WAN LEI, DU BAILIN, ZHANG KAILONG
• Format: Patent
• Language: Chinese; English
• Published: 04.06.2024
• Subjects: CALCULATING; COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS; COMPUTING; COUNTING; ELECTRIC DIGITAL DATA PROCESSING; PHYSICS

The invention discloses a multi-modal detection system driven by artificial intelligence. The multi-modal detection system comprises a data preprocessing module, a multi-modal feature extraction module, a feature fusion module and a detection module, wherein the data preprocessing module is used for processing multi-modal data acquired by the data acquisition device, generating data in a standardized data format, and sending the preprocessed data to the multi-modal feature extraction module; the multi-modal feature extraction module is used for extracting various modal data from the preprocessed data and sending the extracted various modal data to the feature fusion module; the feature fusion module is used for fusing the extracted multiple modal data to form uniform feature representation; the detection module is used for detecting the fused feature data and outputting a detection result; compared with the prior art, the multi-modal data are effectively integrated, and the detection accuracy and efficiency a