REMOTE ASSISTANCE WORKSTATION, METHOD AND SYSTEM WITH A USER INTERFACE FOR REMOTE ASSISTANCE WITH SPATIAL PLACEMENT TASKS VIA AUGMENTED REALITY GLASSES

• Main Authors: DJAJADININGRAT, Johan Partomo, CHAO, Pei-Yin, LUI, Wing Lam
• Format: Patent
• Language: English; French; German
• Published: 16.08.2023
• Subjects: HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATIONTECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING ORPROCESSING OF MEDICAL OR HEALTHCARE DATA; INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTEDFOR SPECIFIC APPLICATION FIELDS; PHYSICS

A remote assistance workstation 12 comprises a communications module 54, a user interface (UI) module 52, and a controller 56, for being coupled to a portable device 14 that includes a pair of augmented reality (AR) glasses 36 worn by a first responder to carry out an action using an object with a subject at a scene. The UI module 52 renders a remote assistant graphical user interface (GUI) 100 that includes (i) a first pane 96 for displaying a live video stream of a remote assistance request and (ii) a second pane 98 for displaying a 2D representation of the object at the scene being moveable therein by remote assistant inputs. The GUI 100 renders a corresponding item of 3D virtual content within the first pane relative to a reference point. The controller 56 outputs remote assistance signals to the portable device 14 for displaying the item of 3D virtual content 38 on the AR glasses in a live view of the scene, appearing at a location determined by the remote assistant inputs moving the 2D representation within the second pane 98 for assisting the first responder at the scene.