Dual-mode recognition system for human face and hand gesture

• Main Authors: HOU YUE'EN, DENG XIAOLIANG, ZHANG YI, DENG JIAMING, ZHOU YAJING, ZHANG NUOYI, LIN WEICONG
• Format: Patent
• Language: Chinese; English
• Published: 31.03.2020
• Subjects: ARRANGEMENTS, SYSTEMS OR APPARATUS FOR CHECKING NOT PROVIDEDFOR ELSEWHERE; CALCULATING; CHECKING-DEVICES; COMPUTING; COUNTING; GENERATING RANDOM NUMBERS; HANDLING RECORD CARRIERS; PHYSICS; PRESENTATION OF DATA; RECOGNITION OF DATA; RECORD CARRIERS; REGISTERING OR INDICATING THE WORKING OF MACHINES; TIME OR ATTENDANCE REGISTERS; VOTING OR LOTTERY APPARATUS

The utility model relates to the technical field of bimodal identification. The utility model relates to a recognition system, in particular to a face and hand gesture bimodal recognition system. Thesystem comprises a video image processing front end and a control rear end. The video image processing front end comprises a visual image processing module, a visual image acquisition camera, an infrared induction sensor, a touch screen, a power supply module and a 4G communication module. The visual image acquisition camera is connected with the visual image processing module through a wire and is used for acquiring hand shape gesture features and face image information of a user, converting the image information into a standard signal and outputting the standard signal to the visual image processing module; the infrared induction sensor is connected with the visual image processing module through a wire and outputs a trigger level signal to the visual image processing module, and the visual image processing module controls the visual image acquisition camera to work. According to the utility model, human faces and hand gestures can be recognized, the work of access control or household equipment can be controlled, and the use accuracy and convenience of the access control or household equipment can be improved. 本实用新型涉及双模态识别技术领域，特别涉及一种人脸及手型手势的双模态识别系统，包括视频图像处理前端和控制后端，视频图像处理前端包视觉图像处理模块、视觉图像采集摄像头、红外感应传感器、触摸屏、电源模块和4G通讯模块，视觉图像采集摄像头通过导线与视觉图像处理模块连接，用于采集用户的手形手势特征和脸部图像信息，并将图像信息转化为标准信号输出给视觉图像处理模块；红外感应传感器通过导线与视觉图像处理模块连接，输出触发电平信号到视觉图像处理模块，通过视觉图像处理模块控制视觉图像采集摄像头工作。本实用新型能够识别人脸及手型手势，控制门禁或家居设备的工作，提高门禁或家居设备的使用准确性和便利性。