Scenario identification for validation and training of machine learning based models for autonomous vehicles

• Main Authors: Hartmann, Till S, Zaremba, Jeffrey D, Anthony, Samuel English
• Format: Patent
• Language: English
• Published: 05.03.2024
• Subjects: CALCULATING; COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS; COMPUTING; CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE ORDIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; CONTROLLING; COUNTING; ELECTRIC DIGITAL DATA PROCESSING; PERFORMING OPERATIONS; PHYSICS; REGULATING; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TOTHE CONTROL OF A PARTICULAR SUB-UNIT; SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES; TRANSPORTING; VEHICLES IN GENERAL

A system uses a machine learning based model to determine attributes describing states of mind and behavior of traffic entities in video frames captured by an autonomous vehicle. The system classifies video frames according to traffic scenarios depicted, where each scenario is associated with a filter based on vehicle attributes, traffic attributes, and road attributes. The system identifies a set of video frames associated with ground truth scenarios for validating the accuracy of the machine learning based model and predicts attributes of traffic entities in the video frames. The system analyzes video frames captured after the set of video frames to determine actual attributes of the traffic entities. Based on a comparison of the predicted attributes and actual attributes, the system determines a likelihood of the machine learning based model making accurate predictions and uses the likelihood to generate a navigation action table for controlling the autonomous vehicle.