Positional analysis using computer vision sensor synchronization

• Main Authors: Tong, Xiaofeng, Zhang, Lidan, Fang, Yikai, Li, Qiang Eric, Li, Wenlong, Jiao, Shaohui, Shen, Xiaolu, Zeng, Fucen
• Format: Patent
• Language: English
• Published: 12.07.2022
• Subjects: ADVERTISING; AMUSEMENTS; APPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING,CLIMBING, OR FENCING; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND,DEAF OR MUTE; BALL GAMES; CALCULATING; COMPUTING; COUNTING; CRYPTOGRAPHY; DIAGRAMS; DISPLAY; EDUCATION; EDUCATIONAL OR DEMONSTRATION APPLIANCES; GAMES; GLOBES; HUMAN NECESSITIES; IMAGE DATA PROCESSING OR GENERATION, IN GENERAL; PHYSICS; PLANETARIA; SEALS; SPORTS; TRAINING EQUIPMENT

System and techniques for positional analysis using computer vision sensor synchronization are described herein. A set of sensor data may be obtained for a participant of an activity. A video stream may be captured in response to detection of a start of the activity in the set of sensor data. The video stream may include images of the participant engaging in the activity. A key stage of the activity may be identified by evaluation of the sensor data. A key frame may be selected from the video stream using a timestamp of the sensor data used to identify the key stage of the activity. A skeletal map may be generated for the participant in the key frame using key points of the participant extracted from the key frame. Instructional data may be selected using the skeletal map. The instructional data may be displayed on a display device.