Teleoperation attitude tracking estimation system and method

• Main Authors: HUANG JIALE, GUO JIANWEN, MIAO HANQI, SUN ZHENZHONG, LUO XIAOJIE
• Format: Patent
• Language: Chinese; English
• Published: 28.12.2021
• Subjects: CALCULATING; COMPUTING; COUNTING; IMAGE DATA PROCESSING OR GENERATION, IN GENERAL; PHYSICS

The invention relates to the technical field of robot digital twinning, in particular to a teleoperation attitude tracking estimation system and method which are applied to a complex environment. The system comprises a teleoperation mechanical arm, a motion capture system, a signal generator and at least three industrial cameras; the three industrial cameras are simultaneously connected with an external trigger signal device through signal lines, the motion capture system is in communication connection with the industrial cameras and cooperates with the industrial cameras to carry out three-dimensional attitude data acquisition, and visual marks are designed on the teleoperation mechanical arm; the motion capture system carries out image data acquisition, image data processing, data collection and production, data training iteration, data model storage and output to generate a coordinate system, so virtual environment 3D construction of an objective environment where the mechanical arm is located is determine