Method for aligning a three-dimensional model of a dentition of a patient to an image of the face of the patient recorded by camera

• Main Authors: Lancelle, Marcel, Degen, Nicolas, Nemanja, Bartolovic, Mörzinger, Roland, Sörös, Gábor
• Format: Patent
• Language: English
• Published: 03.01.2023
• Subjects: CALCULATING; COMPUTING; COUNTING; IMAGE DATA PROCESSING OR GENERATION, IN GENERAL; PHYSICS

The present invention relates to a computer implemented method for aligning a three-dimensional model (6) of a patient's dentition to an image of the face of the patient recorded by a camera (3), the image including the mouth opening, comprising:estimating the positioning of the camera (3) relative to the face of the patient during recording of the image to obtain an estimated positioning,retrieving the three-dimensional model (6) of the dentition of the patient,rendering a two-dimensional image (7) of the dentition of the patient using the virtual camera (8) processing the three-dimensional model (6) of the dentition at the estimated positioning,carrying out feature detection in a dentition area in the mouth opening of the image (1) of the patient recorded by the camera (3) and in the rendered image (7) by performing edge detection and/or a color-based tooth likelihood determination in the respective images and forming a detected feature image for the or each detected feature,calculating a measure of deviation between the detected feature images of the image taken by the camera (3) and the detected feature image of the rendered image,varying the positioning of the virtual camera (8) to a new estimated positioning and repeating the preceding three steps in an optimization process to minimize the deviation measure to determine the best fitting positioning of the virtual camera (8).