Method and apparatus for providing driver information via audio and video metadata extraction

• Main Authors: Welland, Robert Victor, Ludwig, John Hayes, Cordell, John Palmer, McKelvie, Samuel James
• Format: Patent
• Language: English
• Published: 21.01.2020
• Subjects: ANALOGOUS ARRANGEMENTS USING OTHER WAVES; ARRANGEMENT OF SIGNALLING OR LIGHTING DEVICES, THE MOUNTING ORSUPPORTING THEREOF OR CIRCUITS THEREFOR, FOR VEHICLES INGENERAL; CALCULATING; COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS; COMPUTING; CONTROLLING; COUNTING; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; ELECTRIC COMMUNICATION TECHNIQUE; ELECTRICITY; GYROSCOPIC INSTRUMENTS; HANDLING RECORD CARRIERS; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION ORRERADIATION OF RADIO WAVES; MEASURING; MEASURING DISTANCES, LEVELS OR BEARINGS; NAVIGATION; PERFORMING OPERATIONS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY; PHYSICS; PICTORIAL COMMUNICATION, e.g. TELEVISION; PRESENTATION OF DATA; RADIO DIRECTION-FINDING; RADIO NAVIGATION; RECOGNITION OF DATA; RECORD CARRIERS; REGULATING; SIGNALLING; SURVEYING; SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES; TESTING; TRAFFIC CONTROL SYSTEMS; TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHICCOMMUNICATION; TRANSPORTING; VEHICLES IN GENERAL; VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISEPROVIDED FOR; WIRELESS COMMUNICATIONS NETWORKS

A method and/or system is able to provide driver fingerprint via metadata extraction managed by a driver rating ("DR") model trained by a machine learning center ("MLC") coupled to a cloud based network ("CBN"). In one embodiment, a DR system includes a set of outward facing cameras, a set of inward facing cameras, and a vehicle onboard computer ("VOC"). The set of outward facing cameras mounted on a vehicle is used to collect external images representing a surrounding environment in which the vehicle operates. The set of inward facing cameras mounted in the vehicle is used to collect internal images including operator body expression representing at least operator's attention. The VOC is configured to determine the identity of operator and current operating style in response to the collected internal images, the collected external images, and historical stored data.