Medical procedures using augmented reality

• Main Authors: YIN, WEI, KWON KIYOUNG, J.M.LEE, J.W.LEE, LUO, SIFEN
• Format: Patent
• Language: Chinese; English
• Published: 03.06.2022
• Subjects: CALCULATING; COMPUTING; COUNTING; IMAGE DATA PROCESSING OR GENERATION, IN GENERAL; PHYSICS

The present disclosure provides a method of performing a medical procedure using augmented reality that superimposes a medical image (e.g., CT or MRI) of a patient on a real-time camera view of the patient. Prior to the medical procedure, a medical image of the patient is processed to generate a 3D model representing a skin profile of the body of the patient. The 3D model is further processed to generate skin markings including only selected portions of the 3D model. During the medical procedure, a 3D image of the patient's body is captured using a camera, and then the 3D image is registered with the skin indicia. A medical image of the patient may then be superimposed on the real-time camera view, which is presented to a person performing the medical procedure. 本公开提供了一种使用将患者的医学图像(例如，CT或MRI)叠加在所述患者的实时相机视图上的增强现实进行医疗程序的方法。在所述医疗程序之前，处理所述患者的医学图像以生成表示所述患者的身体的皮肤轮廓的3D模型。进一步处理所述3D模型以生成仅包括所述3D模型的选定部分的皮肤标记。在所述医疗程序时，使用相机捕获所述患者的身体的3D图像，然后将所述3D图像与所述皮肤标记配准。然后，可将所述患者的医学图像叠加在所述实时相机视图上，所述实时相机视图被呈现给执行所述医疗程序的人员。