Spatially variant biases considered self-supervised depth estimation based on laparoscopic videos

• Published in: Computer methods in biomechanics and biomedical engineering. Vol. 10; no. 3; pp. 274 - 282
• Main Authors: Li, Wenda, Hayashi, Yuichiro, Oda, Masahiro, Kitasaka, Takayuki, Misawa, Kazunari, Mori, Kensaku
• Format: Journal Article
• Language: English
• Published: Taylor & Francis 04.05.2022
• Subjects: Depth estimation; laparoscopic videos; self-supervised
• DOI: 10.1080/21681163.2021.2015723
• ISSN: 2168-1163

Depth estimation is an essential tool in obtaining depth information for robotic surgery and augmented reality technology in the current laparoscopic surgery robot system. Since there is a lack of ground-truth for depth values and laparoscope motions during operation, depth estimation networks have difficulties in predicting depth maps from laparoscopic images under the supervised strategy. It is challenging to generate the correct depth maps for the different environments from abdominal images. To tackle these problems, we propose a novel monocular self-supervised depth estimation network with sparse nest architecture. We design a non-local block to capture broader and deeper context features that can further enhance the scene-variant generalisation capacity of the network for the differences in datasets. Moreover, we introduce an improved multi-mask feature in the loss function to tackle the classical occlusion problem based on the time-series information from stereo videos. We also use heteroscedastic aleatoric uncertainty to reduce the effect of noisy data for depth estimation. We compared our proposed method with other existing methods for different scenes in datasets. The experimental results show that the proposed model outperformed the state-of-the-art models qualitatively and quantitatively.