Intelligent interactive shadow puppet system, control method, equipment and medium

• Main Authors: LUO WEIBIN, ZHAO JIANWEN, ZHU LIANGZHE, XIE ZIYUAN, ZENG JUNYING, HUANG GUOLIN, ZHONG CHUNCHAN, XU DONG, QIN CHUANBO, ZHAO JIAXI, WU JIANYU
• Format: Patent
• Language: Chinese; English
• Published: 05.09.2023
• Subjects: ACOUSTICS; CALCULATING; CHAMBERS PROVIDED WITH MANIPULATION DEVICES; COMPUTING; COUNTING; HAND TOOLS; IMAGE DATA PROCESSING OR GENERATION, IN GENERAL; MANIPULATORS; MUSICAL INSTRUMENTS; PERFORMING OPERATIONS; PHYSICS; PORTABLE POWER-DRIVEN TOOLS; SPEECH ANALYSIS OR SYNTHESIS; SPEECH OR AUDIO CODING OR DECODING; SPEECH OR VOICE PROCESSING; SPEECH RECOGNITION; TRANSPORTING

The embodiment of the invention provides an intelligent interactive shadow puppet system, a control method, equipment and a medium, and the method comprises the steps: carrying out the key point detection according to an image frame of a human motion video, and obtaining human skeleton key points of the image frame; connecting human skeleton key points to obtain human joints; performing kinematics derivation according to the human body joints of the plurality of image frames to obtain joint motion information of the shadow puppet robot; obtaining a driver motion control signal of the shadow puppet robot according to the joint motion information of the shadow puppet robot; controlling the shadow puppet robot to move according to the driver motion control signal of the shadow puppet robot; human body motion information is obtained by detecting human body skeleton key points and human body joints, and the human body motion information is mapped to joint motion information of the shadow puppet robot, so that the