Accuracy of automated 3D cephalometric landmarks by deep learning algorithms: systematic review and meta-analysis

• Published in: Radiologia medica Vol. 128; no. 5; pp. 544 - 555
• Main Authors: Serafin, Marco, Baldini, Benedetta, Cabitza, Federico, Carrafiello, Gianpaolo, Baselli, Giuseppe, Del Fabbro, Massimo, Sforza, Chiarella, Caprioglio, Alberto, Tartaglia, Gianluca M.
• Format: Journal Article
• Language: English
• Published: Milan Springer Milan 01.05.2023; Springer Nature B.V
• Subjects: Accuracy; Algorithms; Anatomic Landmarks; Annotations; Automation; Cephalometry - methods; Computed Tomography; Deep Learning; Diagnostic Radiology; Heterogeneity; Humans; Imaging; Imaging, Three-Dimensional - methods; Interventional Radiology; Machine learning; Medical imaging; Medicine; Medicine & Public Health; Meta-analysis; Neuroradiology; Qualitative analysis; Radiology; Reproducibility of Results; Systematic review; Ultrasound; Deep learning; Orthodontics; Three-dimensional imaging; Landmark; Maxillofacial
• ISSN: 1826-6983; 0033-8362; 1826-6983
• DOI: 10.1007/s11547-023-01629-2

Objectives The aim of the present systematic review and meta-analysis is to assess the accuracy of automated landmarking using deep learning in comparison with manual tracing for cephalometric analysis of 3D medical images. Methods PubMed/Medline, IEEE Xplore, Scopus and ArXiv electronic databases were searched. Selection criteria were: ex vivo and in vivo volumetric data images suitable for 3D landmarking (Problem), a minimum of five automated landmarking performed by deep learning method (Intervention), manual landmarking (Comparison), and mean accuracy, in mm, between manual and automated landmarking (Outcome). QUADAS-2 was adapted for quality analysis. Meta-analysis was performed on studies that reported as outcome mean values and standard deviation of the difference (error) between manual and automated landmarking. Linear regression plots were used to analyze correlations between mean accuracy and year of publication. Results The initial electronic screening yielded 252 papers published between 2020 and 2022. A total of 15 studies were included for the qualitative synthesis, whereas 11 studies were used for the meta-analysis. Overall random effect model revealed a mean value of 2.44 mm, with a high heterogeneity ( I 2  = 98.13%, τ 2  = 1.018, p -value < 0.001); risk of bias was high due to the presence of issues for several domains per study. Meta-regression indicated a significant relation between mean error and year of publication ( p value = 0.012). Conclusion Deep learning algorithms showed an excellent accuracy for automated 3D cephalometric landmarking. In the last two years promising algorithms have been developed and improvements in landmarks annotation accuracy have been done.