Systems and Methods for Providing an Improved Interface for Remote Assistance Operators

• Main Authors: Bartel, Emily Cairns Duff, Zhu, Shanshan, Eckstrom, Julien, Ghorbanian-Matloob, Samann, Huang, Michael Guanran, Zhukov, Alex, Eperjesi, Robert, Toshniwal, Ankur, Tokadl?, Güliz
• Format: Patent
• Language: English
• Published: 28.04.2022
• Subjects: CONTROLLING; PHYSICS; REGULATING; SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES

Systems and methods for improving remote operator assistance for an autonomous vehicle are provided. In particular, a computing system can obtain a plurality of sensor sweeps. The computing system can receive a request for remote assistance from an autonomous vehicle. The computing system can receive real-time video data from the autonomous vehicle. The computing system can receive real-time telemetry data from the autonomous vehicle. The computing system can present the real-time video data in a remote assistance interface. The computing system can generate a graphical overlay based on the telemetry data and display it in a remote assistance user interface over the real-time video data. The computing system can display one or more remote assistance options in the remote assistance user interface. The computing system can transmit instructions to perform one or more of the remote assistance options based on input from a remote assistance operator.