HEAD MOUNTED DISPLAY DEVICE AND SYSTEM FOR REALTIME GUIDANCE

• Main Authors: SPAAS Cédric, AFZAL Hassan, DE LA CADENA Augusto Wladimir
• Format: Patent
• Language: English
• Published: 19.08.2024
• Subjects: ELECTRIC COMMUNICATION TECHNIQUE; ELECTRICITY; PICTORIAL COMMUNICATION, e.g. TELEVISION

A head mounted display (HMD) device and an image-based guidance system are disclosed. The HMD has sensors imaging a scene as pixel data and a display outputting a graphical user interface (GUI). The HMD has one or more parallel processing modules, each configured with a plurality of pixel-respective data processing threads, which receives the pixel data from the sensors, filters same to segregate pixel data representative of an optical contrasting agent applied to at least one target in the scene, and computes two-dimensional (2D) pixel coordinate data from segregated pixel data. Data processing means of the HMD transforms 2D pixel coordinate data by reference to a first geometrical dataset into three-dimensional (3D) coordinate data representative of the or each target relative to the device, generates 3D guidance data by reference to one or more further geometrical datasets, each representative of a respective target in the scene, and outputs the 3D guidance data to the GUI.