Uncertainty meets 3D-spatial feature in colonoscopic polyp-size determination

• Published in: Computer methods in biomechanics and biomedical engineering. Vol. 10; no. 3; pp. 289 - 298
• Main Authors: Itoh, Hayato, Oda, Masahiro, Jiang, Kai, Mori, Yuichi, Misawa, Masashi, Kudo, Shin-Ei, Imai, Kenichiro, Ito, Sayo, Hotta, Kinichi, Mori, Kensaku
• Format: Journal Article
• Language: English
• Published: Taylor & Francis 04.05.2022
• Subjects: computer-aided diagnosis; depth estimation; polyp localisation; Polyp-size estimation
• ISSN: 2168-1163; 2168-1171
• DOI: 10.1080/21681163.2021.2004445

This paper presents a new 3D-spatial feature extraction from a 2D colonoscopic image for polyp-size estimation. The polyp-size estimation poses potential demands on colonoscopy, since an endoscopist's subjective estimation is apt to result in uncertain polyp-size determination. This uncertain determination is derived from the lack of 3D-spatial information. Even though a previous work clarified that depth estimation mitigates uncertainty in binary polyp-size classification, precise estimation of 3D structure from a colonoscopic image(s) remains an unsolved challenge in medical image analysis. This work proposes a 3D-spatial feature that expresses a polyp's precise 3D shape to mitigate uncertainty in polyp-size determination. First, we introduce an accurate depth estimation method to capture the 3D structure of a colon. Next, we integrate depth estimation and polyp localisation to extract a 3D polyp shape as a feature. Finally, we achieve polyp-size estimation by statistical learning of extracted features. The experimental results demonstrated the validity both of our depth estimation and 3D-spatial feature. Compared with deep RGB and RGB-D convolutional neural networks (CNNs), a shallow CNN with the proposed 3D-spatial feature achieved a more accurate polyp-size estimation with a mean absolute error of 1.36 mm, whereas the one of the deep CNN is 3.11 mm.