IMAGING AND RADAR FUSION FOR MULTIPLE-OBJECT TRACKING

• Main Authors: ZHENG YANG, IZZAT IZZAT H, SONG SANLING
• Format: Patent
• Language: Chinese; English
• Published: 13.08.2021
• Subjects: ANALOGOUS ARRANGEMENTS USING OTHER WAVES; CALCULATING; COMPUTING; COUNTING; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION ORRERADIATION OF RADIO WAVES; MEASURING; PHYSICS; RADIO DIRECTION-FINDING; RADIO NAVIGATION; TESTING

This document describes methods and systems directed at imaging sensor and radar fusion for multiple-object tracking. Using tracking-by-detection, an object is first detected in a frame captured by an imaging sensor, and then the object is tracked over several consecutive frames by both the imaging sensor and a radar system. The object is tracked by assigning a probability that the object identified in one frame is a same object identified in the consecutive frame. A probability is calculated for each data set captured by a sensor by a supervised-learning neural-network model using the data collected from the sensors. Then, the probabilities associated with each sensor are fused into a refined probability. By fusing the data gathered by the imaging sensor and the radar system in the consecutive frames, a safety system can track multiple objects more accurately and reliably than using the sensor data separately to track objects. 本文档描述了涉及多个对象跟踪的成像传感器和雷达融合的方法和系统。使用按检测跟踪，首先在由成像传感器捕获的帧中检测对象，然后通过成像传感器和雷达系统两者在若干连续的帧