DATA FUSION SYSTEM FOR A VEHICLE EQUIPPED WITH UNSYNCHRONIZED PERCEPTION SENSORS

• Main Authors: Ozbilgin, Guchan, Xu, Wenda, Wang, Yimu, Snider, Jarrod M, Wei, Junqing, Yang, Yifan
• Format: Patent
• Language: English
• Published: 26.09.2019
• Subjects: CALCULATING; COMPUTING; CONTROLLING; COUNTING; IMAGE DATA PROCESSING OR GENERATION, IN GENERAL; PHYSICS; REGULATING; SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES

A sensor data fusion system for a vehicle with multiple sensors includes a first-sensor, a second-sensor, and a controller-circuit. The first-sensor is configured to output a first-frame of data and a subsequent-frame of data indicative of objects present in a first-field-of-view. The first-frame is characterized by a first-time-stamp, the subsequent-frame of data characterized by a subsequent-time-stamp different from the first-time-stamp. The second-sensor is configured to output a second-frame of data indicative of objects present in a second-field-of-view that overlaps the first-field-of-view. The second-frame is characterized by a second-time-stamp temporally located between the first-time-stamp and the subsequent-time-stamp. The controller-circuit is configured to synthesize an interpolated-frame from the first-frame and the subsequent-frame. The interpolated-frame is characterized by an interpolated-time-stamp that corresponds to the second-time-stamp. The controller-circuit fuses the interpolated-frame with the second-frame to provide a fused-frame of data characterized by the interpolated-time-stamp, and operates the host-vehicle in accordance with the fused-frame.